i2k2 - Python Developer - Web Crawling (3-6 yrs)

Profile : Python Developer

Experience : 3 To 6 Years

Requirement : Expertise in Python Development, AWS, Web Crawling, Databases (MYSQL, SQL SERVER), etc.

Location : Work From Office (Work From Office)

Working Days : 5

Prefer Immediate Joiners.

Job Description :

• Collaborate with development teams to identify and define application requirements.
• Develop scalable and efficient code using the Python programming language.
• Conduct thorough testing and debugging to ensure functionality and performance.
• Design and implement back-end components to enhance system performance.
• Evaluate and prioritize client feature requests, aligning them with business objectives.
• Integrate data storage solutions to improve application efficiency.
• Optimize existing databases to streamline operations and enhance functionality.
• Develop digital tools for monitoring and analyzing online traffic, providing insights for continuous improvement.
• Write clean, efficient, and scalable code to support application growth.
• Perform rigorous testing to ensure program stability and reliability.
• Enhance existing systems by implementing necessary improvements and updates.
• Coordinate with internal teams to gather user requirements and deliver tailored technical solutions.
• Develop and maintain web scrapers using Python libraries such as Scrapy, BeautifulSoup, Selenium, and Requests.
• Automate data extraction, processing, and storage pipelines to optimize workflow efficiency.
• Work with SQL databases (MySQL, PostgreSQL, etc.) to ensure optimal data storage and retrieval.
• Handle API integrations for seamless third-party data collection and automation.
• Implement proxy management, CAPTCHA bypass techniques, and session handling to ensure uninterrupted data extraction.
• Ensure compliance with legal and ethical guidelines in web scraping practices.
• Collaborate with data analysts and developers to seamlessly integrate extracted data into applications.
• Troubleshoot and resolve issues related to web crawling and automation scripts to maintain smooth operations.