Job Title: Software Engineer – Experience: 1-2 Years
Location: Any Where (Preferred Coimbatore)
Job Type: Full time / Work from office - Rotational shift
Salary Package: TBD

Job Description:

We are seeking a Python Developer with a passion for web scraping to join our dynamic team. If you have a keen eye for data extraction, a strong coding background, and a desire to work on exciting web scraping projects, this role is for you.
Requirement:
A minimum of 1-2 years of prior experience with crawling systems and frameworks is required.
Bachelor's degree in Computer Science, Information Technology, or a related field.
Proven experience with web scraping using Python, including libraries like Scrapy, Beautiful Soup, Selenium, and Puppeteer.
Strong understanding of web technologies such as HTML, JavaScript, CSS, and HTTP protocols.
Proficiency in data formats like XML, JSON, and familiarity with XPath.
Experience in solving CAPTCHA challenges and handling anti-bot mechanisms.
Knowledge of database systems and SQL for data storage and retrieval. Knowledge in MongoDB would be an advantage
Solid understanding of Git for version control.
Strong problem-solving skills and attention to detail.
Excellent communication and teamwork skills.
Ability to work independently and meet project deadlines.

Responsibilities:

Develop and maintain web scraping scripts and applications using Python.
Collaborate with cross-functional teams to identify data sources, extraction requirements, and project goals.
Extract, transform, and load (ETL) data from various websites and APIs efficiently.
Implement data quality checks and error handling mechanisms to ensure robust scraping pipelines.
Optimize web scraping performance and scalability.
Stay up-to-date with the latest web scraping technologies and best practices.
Troubleshoot and resolve any issues related to web scraping processes.
Work on enhancing and maintaining existing web scraping systems.