Short description
Name: Craigslist Scraper
Purpose: Search and list latest posts from craigslist by grouped categories or cities
Search criteria
The application contains these search fields.
- Country or Contents
- By this field you can define country (USA, Canada) or content (Africa, Asia, Europe & etc.)
- States
- If you define USA or Canada at first field state dropdown list will appear.
- City
- At this field the cities will appear which belong state or country you choose before. You can choose multiple citites at once.
- Category
- You can search by category or can list all categorise at once by choosing “All” option.
- Search text
- You can define search text to search posts which contains this text
Structure
The application has two (API server and client interface) sides. With client interfaces (GUI) you define search fields and get results. At server side the posts filtered by search criteria an return JSON data to interfaces.
GUI
The modern technologies as AngularJS, Node JS and Material Design used to create user interface. The Main layout contains two divided block. First block (left side) keeps search form and second block (right side) show results.
Dependencies
System requirements is:
- Node JS with NPM
- Angular JS
- Material Design
- NPM Express
- NPM body-parser
Installation
- Install Node JS
- Download installer file depending on your OS
- Run installer file and follow wizard window
- Extract all files of zip package into you root directory
- Install NPM dependencies
- Open CMD or PowerShell for Windows OS or terminal for Mac and Linux OS
- Locate the folder where you extract zip package. You can use CD command for major OS
- Execute “npm install” command
- Start application
- Execute “npm start” command
- Open any browser (Chrome or Firefox recommended) and locate “localhost:8080” address.
- THAT’S ALL )))
Configuration
If you start this application remote server or PC you need to change serviceBase at line 4 of server.js file in publicjs folder.