Staff Data Engineer
Apply now and our proprietary system will quickly have you in front of a live recruiter.
The Opportunity
Description
We're looking for a Staff Data Engineer, working in Manufacturing industry in San Diego, California, United States.- Work with Manufacturing Ops, Supply Chain, Commercial, Quality, and Finance analytics teams to ascertain business requirements for cloud data repositories and data pipelines in support of analytics and data science
- Design, build, and enhance a set of robust, automated data pipelines, driven by event streams, replication, and/or batches, to create and refresh diverse datasets
- Design, instantiate, load, and refresh tables in Snowflake
- Ingest data using Fivetran (CDC replication, APIs), GCP GCS, Kafka, Snowpipe, and ETL tools (Snaplogic, Boomi)
- Transform data using DBT and stored procedures
- Write algorithms for data pipeline testing and continuous monitoring
- Administer role-based security in cloud data platform via Active Directory Groups fed via Okta SSO
- Enable organizationally distributed business analysts in their delivery of robust, test-driven, self-service data wrangling, visual analytics, and solution sharing
- Manage dynamic configurations, CI/CD for data pipelines, cloud data environments and repositories for versioned code
- Use emerging industry standards to create data pipeline infrastructure as code, automate testing and deployments, employ monitoring tools, and thereby manage the lifecycle of data pipelines and their target data sets needed by multiple business analysis teams across the company
- Maintain, enhance, and deploy development and test environments for core data engineering teams and distributed business analytics teams
- Oversee the creation and use of early, automated detection and monitoring for data errors that threaten data pipeline operations
- Cultivate alignment across teams: development, system administrators, InfoSec, compliance (FDA regulated), and change management for continuous improvement in the quality and velocity of releases and operational service levels
Our Client
Our client provides agile consulting and staffing. Helping organizations fulfill their most important initiatives and opportunities. For 30 years. From coast-to-coast.
Developing long-term relationships. Successfully retaining clients and placing consultants through multiple engagements.
Providing you with the support, care, and attention you deserve. With advocates available 24x7 to help you with questions and concerns. This personal care together with great work has resulted in a 4.4 Glassdoor rating.
Join the most talented professionals in the industry working on strategic and world-class programs.
Experience Required for Your Success
- Bachelor's Degree in Computer Science or equivalent experience
- 5 plus years of IT operations or DevOps experience provisioning infrastructure, managing configurations, implementing CI/CD pipelines for applications and infrastructure, implementing testing and monitoring tools
- Expertise with core-platform stack: Snowflake, Snowpipe, DBT, SQL, Fivetran, GitHub, Harness, Terraform, and Python
- Experience creating and managing CI/CD orchestration
- Strong customer-service orientation
- Proficient in communicating at both technical and management levels
- Enthusiastic support of win-win relationships across multi-disciplinary teams, so that helpful information sharing becomes a routine expectation
- Proactive at implementing change initiatives, and providing guidance to others in meeting changing needs
- Strong ability to coordinate with people across teams
What Do You Think?
Does your experience reflect what it takes to be successful in this role? Do the work and challenges get you excited about what's possible?
Apply Now
