Data Mining Engineer

1 week ago

Central And Western District, Hong Kong SAR China Datago Technology Limited Full time
We are seeking a skilled and detail-oriented engineer to join our dynamic team. In this role, you will be responsible for the development, maintenance, and optimization of web crawlers and data collection systems. You will work closely with data engineers, software developers, and data analysts to ensure the smooth operation of our data acquisition infrastructure. The ideal candidate has a strong background in web scraping, data extraction, and system monitoring, along with a passion for solving complex technical challenges.

ResponsibilitiesDesign, develop, and maintain web crawlers and data extraction pipelines to collect data from various online sources.Monitor and optimize the performance of crawler systems to ensure high availability, scalability, and efficiency.Troubleshoot and resolve issues related to crawler operations and data quality problems.Collaborate with teams to understand data requirements and implement solutions to meet business needs.Develop and maintain documentation for crawler systems, including technical specifications, operational procedures, and troubleshooting guides.Stay up to date with the latest trends and technologies in web scraping, data extraction, and distributed systems.Automate repetitive tasks and improve system reliability through scripting and tool development.QualificationsBachelor's degree in computer science, Information Technology, or a related field.Proven experience in web scraping, data extraction, and crawler development using tools such as Scrapy, BeautifulSoup, Selenium, or similar frameworks.Strong programming skills in Python.Understanding of network protocols, IP management, and proxy services.Strong problem-solving skills and the ability to work independently or as part of a team.Excellent communication skills and the ability to document technical processes clearly.Preferred QualificationsExperience with machine learning or natural language processing (NLP) techniques for data extraction.Experience with distributed systems, cloud platforms (e.g., AWS, Azure, GCP), and containerization technologies (e.g., Docker, Kubernetes).Knowledge of database systems (SQL, NoSQL) and data storage solutions.Knowledge of data privacy regulations and ethical considerations in web scraping.Familiarity with version control systems (e.g., Git) and CI/CD pipelines.Experience with monitoring tools (e.g., Prometheus, Grafana) and log management systems (e.g., ELK Stack).Location of work:

Hong Kong Science ParkAnnual leave and group medical insuranceGood team cultureAssistance to apply for an IANG VISAAdditional Information

Job Level

Entry levelPublish Date

24/01/2025Job Ref. No.

N/AN/AJob Function

Extraction & MiningResearch & Development (R&D)Software DevelopmentCompany Overview

Datago Technology Limited is a financial technology company primarily focused on providing Chinese text data analytics. By leveraging big data and artificial intelligence technologies to process large-scale text data from comprehensive sources like news, reports, and social media, it provides quantitative and easy-to-use structured data analytics for the capital market in mainland China and Hong Kong. Our machine-readable text data analytics services allow users to overcome language barriers and extract valuable insights from large amounts of information. The products help users enhance returns, reduce risk, and improve operational efficiencies. Datago users include top asset management firms like hedge funds, security brokers, and research institutions worldwide.

#J-18808-Ljbffr

  • Data mining engineer

    4 weeks ago

    Central And Western District, Hong Kong SAR China Datago Technology Limited Full time

    We are seeking a skilled and detail-oriented engineer to join our dynamic team. In this role, you will be responsible for the development, maintenance, and optimization of web crawlers and data collection systems. You will work closely with data engineers, software developers, and data analysts to ensure the smooth operation of our data acquisition...

  • Python data engineer

    4 weeks ago

    Central And Western District, Hong Kong SAR China Datago Technology Limited Full time

    Responsibilities: Develop and maintain the company's data platform, using Python and related data processing tools to build efficient and stable data processing workflows, including data collection, cleaning, transformation, and storage. Design and implement data models according to business requirements to support data analysis, data mining, and machine...

  • Data Analyst

    4 weeks ago

    Central And Western District, Hong Kong SAR China Avature Full time

    The Data Analyst will work with the business to understand the business priorities, design the data-driven solution, and manage a team to develop the solution and business process to deliver measurable business outcomes.Responsibilities:Understand business priorities and requirements and identify opportunities where analytics can create business...

  • Data Analyst

    4 weeks ago

    Central And Western District, Hong Kong SAR China Avature Full time

    The Data Analyst will work with the business to understand the business priorities, design the data-driven solution, and manage a team to develop the solution and business process to deliver measurable business outcomes.Responsibilities:Understand business priorities and requirements and identify opportunities where analytics can create business...

  • Data analyst

    3 weeks ago

    Central And Western District, Hong Kong SAR China Avature Full time

    The Data Analyst will work with the business to understand the business priorities, design the data-driven solution, and manage a team to develop the solution and business process to deliver measurable business outcomes. Responsibilities: Understand business priorities and requirements and identify opportunities where analytics can create business value....

  • Senior Data Architect

    4 weeks ago

    Central And Western District, Hong Kong SAR China Classy Wheeler Limited Full time

    Client Description:Well-known semi-Public utilities companyJob Description:Senior Data ArchitectResponsibilities:Design and develop new data products and integrations, and maintain the overall data roadmap.Coordinate and collaborate with business and functional stakeholders to define and prioritise data and analytics use cases.Formulate and communicate the...

  • Data scientist

    1 week ago

    Central And Western District, Hong Kong SAR China PFCC Group Full time

    Our client, a leading investment bank, is seeking to hire a highly skilled Business Analytics Specialist to drive and execute on their Business Analytics strategy. The successful candidate will leverage Big Data, Machine Learning, Artificial Intelligence, and other advanced analytical concepts to generate deep business insights that inform key strategic...

  • Data scientist

    4 weeks ago

    Central And Western District, Hong Kong SAR China Capax Technology Limited Full time

    On-site Permanent 3 year or below Mid-Senior level Skills: AI Integration, Blockchain, Budgeting Job Description We’re seeking an experienced data scientist to deliver insights on a daily basis. The ideal candidate will have mathematical and statistical expertise, along with natural curiosity and a creative mind, and innovative projects in the fields of...

  • Data scientist

    3 weeks ago

    Central And Western District, Hong Kong SAR China Capax Technology Limited Full time

    On-site Permanent 3 year or below Mid-Senior level Skills: AI Integration, Blockchain, Budgeting Job Description We're seeking an experienced data scientist to deliver insights on a daily basis. The ideal candidate will have mathematical and statistical expertise, along with natural curiosity and a creative mind, and innovative projects in the fields of...

  • Data Engineer

    4 weeks ago

    Central And Western District, Hong Kong SAR China FastLaneRecruit Full time

    Job briefWe are seeking a dedicated and innovative Data Engineer to join our team in Hong Kong. This role involves developing efficient data engineering workflows, optimizing pipelines, and leveraging big data tools to support advanced machine learning applications. If you are passionate about data engineering and AI-driven solutions, this is an excellent...

  • Data engineer

    3 weeks ago

    Central And Western District, Hong Kong SAR China FastLaneRecruit Full time

    Job brief We are seeking a dedicated and innovative Data Engineer to join our team in Hong Kong. This role involves developing efficient data engineering workflows, optimizing pipelines, and leveraging big data tools to support advanced machine learning applications. If you are passionate about data engineering and AI-driven solutions, this is an excellent...

  • Senior data architect

    4 weeks ago

    Central And Western District, Hong Kong SAR China Classy Wheeler Limited Full time

    Client Description: Well-known semi-Public utilities company Job Description: Senior Data Architect Responsibilities: Design and develop new data products and integrations, and maintain the overall data roadmap. Coordinate and collaborate with business and functional stakeholders to define and prioritise data and analytics use cases. Formulate and...

  • Data Engineer

    4 weeks ago

    Central And Western District, Hong Kong SAR China Classy Wheeler Limited Full time

    Innovation company offering premium advertising and data-driven mobile marketing solutionsJob Description• Application development and maintenance of Data Warehouse Projects• Build ETL flows for streaming data transformations for data analyses• Maintain high availability of analytics system• Enhance data collection procedures to include information...

  • Data engineer

    4 weeks ago

    Central And Western District, Hong Kong SAR China Classy Wheeler Limited Full time

    Innovation company offering premium advertising and data-driven mobile marketing solutions Job Description • Application development and maintenance of Data Warehouse Projects• Build ETL flows for streaming data transformations for data analyses• Maintain high availability of analytics system• Enhance data collection procedures to include information...

  • Product Manager

    4 weeks ago

    Central And Western District, Hong Kong SAR China Classy Wheeler Limited Full time

    Product Manager / Data Scientist / Data Analyst - ICClient Description:US-based mobile operating system vendorJob Description:Data Analyst ResponsibilitiesAnalyzing a wide range of data from app store, advertising system, several telemetry components, and financial data to help find pain points, opportunities, things to celebrate, and cool stats to share by...

  • Senior data science associate

    4 weeks ago

    Central And Western District, Hong Kong SAR China Pinpoint Asia Full time

    Senior Data Science Associate - Leading Financial Institution Our client is a major global financial institution and is seeking a talented Data Science Associate. Your responsibilities include ensuring that all data analytics and mining activities adhere to data governance standards and maintaining data integrity. You will engage with stakeholders to...

  • Product manager

    3 weeks ago

    Central And Western District, Hong Kong SAR China Classy Wheeler Limited Full time

    Product Manager / Data Scientist / Data Analyst - ICClient Description: US-based mobile operating system vendor Job Description: Data Analyst Responsibilities Analyzing a wide range of data from app store, advertising system, several telemetry components, and financial data to help find pain points, opportunities, things to celebrate, and cool stats to share...

  • Junior System Engineer/ System Engineer

    4 weeks ago

    Central And Western District, Hong Kong SAR China Data Digitalisation Limited Full time

    On-site Full Time Permanent 2 year or above AssociateSkills:Communication, CSS, DockerJob Summary:We are seeking a highly skilled and experienced Software Engineer to join our development team. The ideal candidate will have expertise in PHP/Python web application development, with a strong focus on back-end development.You will be responsible for developing,...

  • Junior system engineer/ system engineer

    4 weeks ago

    Central And Western District, Hong Kong SAR China Data Digitalisation Limited Full time

    On-site Full Time Permanent 2 year or above Associate Skills: Communication, CSS, Docker Job Summary: We are seeking a highly skilled and experienced Software Engineer to join our development team. The ideal candidate will have expertise in PHP/Python web application development, with a strong focus on back-end development. You will be responsible for...

  • Critical facilities engineer, hong kong

    4 weeks ago

    Central And Western District, Hong Kong SAR China Vantage Data Centers Full time

    Critical Facilities Engineer, Hong Kong Critical Facilities Engineer, Hong Kong Apply locations Hong Kong, Hong Kong SAR time type Full time posted on Posted 30+ Days Ago job requisition id R16312 About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek...