AVP Big Data Engineer

  • Highly Competitive
  • Singapur, Singapore
  • Festanstellung, Vollzeit
  • GQR
  • 15 Okt 18

Join a highly empowered team within this Principal Investment Corporation in Singapore, with hundreds of billions of US dollars in assets under management. Exercise your technical expertise to build a world-class market intelligence platform and showcase valuable insights from the vast amount of data exclusive to the firm.

Responsibilities

  • Architect, build and maintain a world-class distibuting computing platform which will enable the in-house data scientists and analysts to effectively execute their research and machine learning
  • Develop unit, integration, system or any tests required to assist the team in delivering high quality and high value results
  • Design and implement data pipelines at Big Data scale. This includes writing efficient parsers, ETL processing, Big Data Ingestion and tools/APIs to provide high quality data visualisation
  • Assist in the transformation of prototypes into models running in production
  • Collect and merge various data sources and prepare the data for visualisation
  • Defining conceptual/logical data model and data architecture and strategy to meet agreed to business requirements of high resolution images
  • Defining the business work process to ensure data standards are met and ensure ongoing data quality, security and governance

Requirements

  • Singaporean Citizenship or Permanent Residency
  • Demonstrated real world skills in database architecture and data modeling
  • 2+ years strong Python development experience, 
  • Demonstrated proficiency in data warehousing, ETL and working with Big Data
  • Experience working with large scale datasets - SQL is a must
  • Production working experience with Hadoop and Spark
  • Technical expertise in either Java, Scala, C++
  • Strong understanding of complex algorithms
  • Ability to build data pipelines 
  • A disciplined approach to version control, code review, automated unit and integration testing, regression testing, automated deployment, runtime monitoring
  • Prior experience in implementing delivery pipelines on Jenkins or other similar CI/CD platform
  • Prior exposure to working with financial data will be highly regarded

Qualifications

  • Ph.D. / Master’s / Bachelors Degree in Computer Sciences and Engineering
  • Experience with and staying current on modern data science tools
  • Strong hands on and problem solving skills, and agility to manage multiple tasks.