Data mining engineer

4 weeks ago

Central And Western District, Hong Kong SAR China Datago Technology Limited Full time

We are seeking a skilled and detail-oriented engineer to join our dynamic team. In this role, you will be responsible for the development, maintenance, and optimization of web crawlers and data collection systems. You will work closely with data engineers, software developers, and data analysts to ensure the smooth operation of our data acquisition infrastructure. The ideal candidate has a strong background in web scraping, data extraction, and system monitoring, along with a passion for solving complex technical challenges. Responsibilities Design, develop, and maintain web crawlers and data extraction pipelines to collect data from various online sources. Monitor and optimize the performance of crawler systems to ensure high availability, scalability, and efficiency. Troubleshoot and resolve issues related to crawler operations and data quality problems. Collaborate with teams to understand data requirements and implement solutions to meet business needs. Develop and maintain documentation for crawler systems, including technical specifications, operational procedures, and troubleshooting guides. Stay up to date with the latest trends and technologies in web scraping, data extraction, and distributed systems. Automate repetitive tasks and improve system reliability through scripting and tool development. Qualifications Bachelor's degree in computer science, Information Technology, or a related field. Proven experience in web scraping, data extraction, and crawler development using tools such as Scrapy, Beautiful Soup, Selenium, or similar frameworks. Strong programming skills in Python. Understanding of network protocols, IP management, and proxy services. Strong problem-solving skills and the ability to work independently or as part of a team. Excellent communication skills and the ability to document technical processes clearly. Preferred Qualifications Experience with machine learning or natural language processing (NLP) techniques for data extraction. Experience with distributed systems, cloud platforms (e.g., AWS, Azure, GCP), and containerization technologies (e.g., Docker, Kubernetes). Knowledge of database systems (SQL, No SQL) and data storage solutions. Knowledge of data privacy regulations and ethical considerations in web scraping. Familiarity with version control systems (e.g., Git) and CI/CD pipelines. Experience with monitoring tools (e.g., Prometheus, Grafana) and log management systems (e.g., ELK Stack). Location of work: Hong Kong Science Park Annual leave and group medical insurance Good team culture Assistance to apply for an IANG VISAAdditional Information Job Level Entry level Publish Date24/01/2025 Job Ref. No. N/AN/AJob Function Extraction & Mining Research & Development (R&D)Software Development Company Overview Datago Technology Limited is a financial technology company primarily focused on providing Chinese text data analytics. By leveraging big data and artificial intelligence technologies to process large-scale text data from comprehensive sources like news, reports, and social media, it provides quantitative and easy-to-use structured data analytics for the capital market in mainland China and Hong Kong. Our machine-readable text data analytics services allow users to overcome language barriers and extract valuable insights from large amounts of information. The products help users enhance returns, reduce risk, and improve operational efficiencies. Datago users include top asset management firms like hedge funds, security brokers, and research institutions worldwide.#J-18808-Ljbffr

  • Data Analyst

    4 weeks ago

    Central And Western District, Hong Kong SAR China Avature Full time

    The Data Analyst will work with the business to understand the business priorities, design the data-driven solution, and manage a team to develop the solution and business process to deliver measurable business outcomes.Responsibilities:Understand business priorities and requirements and identify opportunities where analytics can create business...

  • Data analyst

    4 weeks ago

    Central And Western District, Hong Kong SAR China Avature Full time

    The Data Analyst will work with the business to understand the business priorities, design the data-driven solution, and manage a team to develop the solution and business process to deliver measurable business outcomes. Responsibilities: Understand business priorities and requirements and identify opportunities where analytics can create business value....

  • Data scientist

    2 weeks ago

    Central And Western District, Hong Kong SAR China PFCC Group Full time

    Our client, a leading investment bank, is seeking to hire a highly skilled Business Analytics Specialist to drive and execute on their Business Analytics strategy. The successful candidate will leverage Big Data, Machine Learning, Artificial Intelligence, and other advanced analytical concepts to generate deep business insights that inform key strategic...

  • Data scientist

    4 weeks ago

    Central And Western District, Hong Kong SAR China Capax Technology Limited Full time

    On-site Permanent 3 year or below Mid-Senior level Skills: AI Integration, Blockchain, Budgeting Job Description We’re seeking an experienced data scientist to deliver insights on a daily basis. The ideal candidate will have mathematical and statistical expertise, along with natural curiosity and a creative mind, and innovative projects in the fields of...

  • Data scientist

    3 weeks ago

    Central And Western District, Hong Kong SAR China Capax Technology Limited Full time

    On-site Permanent 3 year or below Mid-Senior level Skills: AI Integration, Blockchain, Budgeting Job Description We're seeking an experienced data scientist to deliver insights on a daily basis. The ideal candidate will have mathematical and statistical expertise, along with natural curiosity and a creative mind, and innovative projects in the fields of...

  • Data engineer

    4 weeks ago

    Central And Western District, Hong Kong SAR China FastLaneRecruit Full time

    Job brief We are seeking a dedicated and innovative Data Engineer to join our team in Hong Kong. This role involves developing efficient data engineering workflows, optimizing pipelines, and leveraging big data tools to support advanced machine learning applications. If you are passionate about data engineering and AI-driven solutions, this is an excellent...

  • Product manager

    4 weeks ago

    Central And Western District, Hong Kong SAR China Classy Wheeler Limited Full time

    Product Manager / Data Scientist / Data Analyst - ICClient Description: US-based mobile operating system vendor Job Description: Data Analyst Responsibilities Analyzing a wide range of data from app store, advertising system, several telemetry components, and financial data to help find pain points, opportunities, things to celebrate, and cool stats to share...

  • Junior system engineer/ system engineer

    4 weeks ago

    Central And Western District, Hong Kong SAR China Data Digitalisation Limited Full time

    On-site Full Time Permanent 2 year or above Associate Skills: Communication, CSS, Docker Job Summary: We are seeking a highly skilled and experienced Software Engineer to join our development team. The ideal candidate will have expertise in PHP/Python web application development, with a strong focus on back-end development. You will be responsible for...

  • Critical facilities engineer, hong kong

    4 weeks ago

    Central And Western District, Hong Kong SAR China Vantage Data Centers Full time

    Critical Facilities Engineer, Hong Kong Critical Facilities Engineer, Hong Kong Apply locations Hong Kong, Hong Kong SAR time type Full time posted on Posted 30+ Days Ago job requisition id R16312 About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek...

  • Critical Facilities Engineer, Hong Kong

    2 weeks ago

    Central And Western District, Hong Kong SAR China Vantage Data Centers Full time

    Critical Facilities Engineer, Hong KongCritical Facilities Engineer, Hong KongApply locations Hong Kong, Hong Kong SAR time type Full time posted on Posted 30+ Days Ago job requisition id R16312About Vantage Data CentersVantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out...

  • Data Analyst

    4 weeks ago

    Central And Western District, Hong Kong SAR China Tbwa ChiatDay Inc Full time

    We are hiring for one of our portfolio companies and they're looking for a Data Analyst to join their team.In this role, you will:Analyze user data to drive growth initiatives, including acquisition, activation, retention, and monetization strategies.Develop dashboards, reports, and visualizations to monitor KPIs and communicate insights to...

  • Senior sales executive

    4 weeks ago

    Central And Western District, Hong Kong SAR China Fenics Market Data Full time

    Be among the first 25 applicants Regional Talent Acquisition & Development Lead | Employer Branding | HR Strategy BGC Group - FENICS Market Data Group Fenics Market Data is the exclusive distributor of Market Data on behalf of the BGC Group of companies. The role of the Senior Sales Executive – Fenics Market Data will be based in Hong Kong and will be...

  • (Senior/) Risk Data Analyst

    4 weeks ago

    Central And Western District, Hong Kong SAR China Tbwa ChiatDay Inc Full time

    OKX will be prioritising applicants who have a current right to work in Hong Kong, and do not require OKX's sponsorship of a visa.Who We AreAt OKX, we believe that the future will be reshaped by crypto, ultimately contributing to every individual's freedom. OKX is a leading crypto exchange and the developer of OKX Wallet, giving millions access to crypto...

  • Data Engineer

    4 weeks ago

    Central And Western District, Hong Kong SAR China Tbwa ChiatDay Inc Full time

    OKX is a leading crypto trading app and a Web3 ecosystem. Trusted by more than 20 million global customers in over 180 international markets, OKX is known for being the fastest and most reliable crypto trading app of choice for investors and professional traders globally.Since 2017, OKX has served a global community of people who share a common interest in...

  • Senior Data Architect

    4 weeks ago

    Central And Western District, Hong Kong SAR China Classy Wheeler Limited Full time

    Client Description:Well-known semi-Public utilities companyJob Description:Senior Data ArchitectResponsibilities:Design and develop new data products and integrations, and maintain the overall data roadmap.Coordinate and collaborate with business and functional stakeholders to define and prioritise data and analytics use cases.Formulate and communicate the...

  • Data analytics engineer

    4 weeks ago

    Central And Western District, Hong Kong SAR China Hong Kong Exchanges And Clearing Limited Full time

    Data Analytics Engineer - Associate - Chief Data Office - ITData Analytics Engineer - Associate - Chief Data Office - ITApply locations HK-TWO ES 8/F CN-Shenzhen time type Full time posted on Posted 30+ Days Ago job requisition id R002200 Company Introduction: We're home to Asia's most dynamic and vibrant capital markets. Connecting capital, ideas,...

  • Data Analytics Engineer

    2 weeks ago

    Central And Western District, Hong Kong SAR China Hong Kong Exchanges and Clearing Limited (HKEX) Full time

    Data Analytics Engineer - Associate - Chief Data Office - ITData Analytics Engineer - Associate - Chief Data Office - ITApply locations HK-TWO ES 8/F CN-Shenzhen time type Full time posted on Posted 30+ Days Ago job requisition id R002200Company Introduction:We're home to Asia's most dynamic and vibrant capital markets.Connecting capital, ideas, inspiration...

  • Senior data engineer

    2 weeks ago

    Central And Western District, Hong Kong SAR China Classy Wheeler Limited Full time

    Major digital and media solutions provider in Hong Kong Job Description Candidates with less experience will be considered as Data Engineer. Responsibilities• Build up best in class data infrastructure, data engineering solutions.• Work with cross-functional teams within the organization of different countries, and working with PB size of data, by using...

  • Data Scientist

    4 weeks ago

    Central And Western District, Hong Kong SAR China Avature Full time

    As a Data Scientist at IBM, you will help transform our clients' data into tangible business value by analyzing information, communicating outcomes, and collaborating on product development. Work with Best in Class open source and visual tools, along with the most flexible and scalable deployment options. Whether it's investigating patient trends or weather...

  • Automation Test Engineer

    2 weeks ago

    Central And Western District, Hong Kong SAR China Luxoft Full time

    We are looking for an experienced Test Engineer to work for one of our clients from the banking industry. The project goal is to maintain and develop solutions focused on OR CRM.Responsibilities:Perform analysis and review of the requirements for the tested system/application.Define and own the automation test strategy and test automation framework; execute...