Associate Data Engineer

Why Mobility Global? At Mobility Global, our mission is to provide the trusted information that helps billions of people build, sell, and own vehicles with confidence. As we shape the next generation of automotive intelligence through innovation, AI, and industry-leading data, we're creating new opportunities for our customers, our business, and our people. Join a team singularly focused on transforming the automotive industry. S&P Global Mobility is Mobility Global — the company behind CARFAX, automotiveMastermind, Market Scan, and Polk Automotive Solutions. Our strength comes from our people, and here, the progress you make helps the entire automotive ecosystem move faster and with greater confidence. What You'll Do Our proprietary software-as-a-service helps automotive dealerships and sales teams better understand and predict exactly which customers are ready to buy, the reasons why, and the key offers and incentives most likely to close the sale. Its micro-marketing engine then delivers the right message at the right time to those customers, ensuring higher conversion rates and a stronger ROI. You will be part of our data platform & product insights data engineering team. As part of this agile team, you will work in our cloud native environment to: Build & support data ingestion and processing pipelines. This will entail extract, load and transform of ‘big data’ from a wide variety of sources, both batch & streaming, using latest data frameworks and technologies Build real-time monitoring dashboards and alerting systems. Partner with product to assemble large, complex data sets that meet functional / non-functional business requirements, ensure build out of Data Dictionaries/data catalog and detailed documentation and knowledge around these data assets, metrics and KPIs. Warehouse this data, build data marts, data aggregations, metrics, KPIs, business logic that leads to actionable insights into our product efficacy, marking platform, customer behaviour, retention etc. What we are looking for: Required Skills: 1-3 years of experience in Big Data and Data Engineering. Strong knowledge of SQL, and experience working with relational databases, as well as working familiarity with a variety of databases. Hands-on experience in modern data platform components such as Spark, Python, etc. Experience with setting up and maintaining Data warehouse (Google BigQuery, Redshift, Snowflake) and Data Lakes (GCS, AWS S3 etc.) for an organization Experience with relational SQL and NoSQL databases, including Postgres and Cassandra / MongoDB. Experience with data pipeline and workflow management tools: Airflow, Dataflow, Dataproc, etc. Experience with Distributed Versioning Control environments such as GIT, Azure DevOps Building Docker images and fetch/promote and deploy to Production. Integrated Docker container orchestration framework using Kubernetes by creating pods, config Maps, deployments using terraform. Strong problem solving and communication skills.