This project is a web scraping tool that extracts job listings for data analyst positions in Australia from the Indeed website. It retrieves information such as job title, company name, and location, and saves the data in a CSV file.
The following libraries are required to run the script:
csv: for reading and writing CSV files.requests: for sending HTTP requests to the website.BeautifulSoup: for parsing the HTML content.
You can install these dependencies using pip:
pip install csv requests beautifulsoup4
-
Clone the repository or download the source code files.
-
Install the required dependencies as mentioned in the "Dependencies" section.
-
Open the
scraper.pyfile in a text editor. -
Set the
urlvariable to the desired URL of the job search page on Indeed. -
Run the
scraper.pyscript. -
The script will scrape the webpage, extract job listings, and save the data in a CSV file named
job.csv.
Contributions to the project are welcome. If you find any issues or want to suggest improvements, please open an issue or submit a pull request.
Please note that web scraping may be against the terms of service of some websites. Use this tool responsibly and make sure to comply with the website's policies and guidelines.
If you have any questions or need further assistance, feel free to contact