[Remote] GCP/Linux Data Engineer (Remote)

Note: The job is a remote job and is open to candidates in USA. Da Vinci is seeking a GCP/Linux Data Engineer to support an engineering team in building a research data platform. The role involves creating and maintaining data pipelines, validation scripts, and user documentation while ensuring data integrity and accessibility.

Responsibilities

• Create, verify, and maintain data replication scripts
• Create, verify, and maintain data validation, processing, and ingestion pipelines
• Deploy and automate the execution of data replication scripts and data pipelines in cloud infrastructure
• Create and maintain data catalogs that describe datasets and their contents (i.e. files, file types, tables/views, columns, fields, etc.)
• Create, verify, and maintain dashboards and reports that characterize ingested datasets
• Create, verify, and maintain data validation scripts/APIs that verify the production dataset contains the correct number of samples/records, expects values/fields/columns are populated, and values are of the correct data type, format, and range
• Deploy and automate the execution of data validation scripts/APIs
• Create and maintain user documentation (dataset descriptions, tutorials, code examples, etc.)
• Define entitlements, user groups, roles, and permissions utilized to grant access to datasets

Skills

• Bachelor's Degree in Computer Science/Engineering or related field with 5 years of experience; OR an Associate's degree in Computer/Science/Engineering or related field with 7 years of experience
• Strong GCP
• Linux system administration and scripting
• Pro Desk API
• In-depth knowledge of software engineering with experience coding applications or services in a high-level language (C, C++, Golang, Java, C# etc.)
• Demonstrated problem solving and time management skills
• Strong technical aptitude for designing and implementing software solutions
• Experience with modern application development frameworks
• Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
• Deep hands-on technical expertise
• Excellent verbal and written communication skills
• Experience with Agile software development techniques

Benefits

• Fully Remote
• W2 Candidates Only

Company Overview