Senior Data Architect & Engineering Lead Job at My3Tech, Remote

ZHZVa1dGcklnb0czNFNUTkhBekY0T1NSZmc9PQ==
  • My3Tech
  • Remote

Job Description

Hello,

Hope you are doing good.

Position: Senior Data Architect & Engineering Lead

Location: US Remote

Duration: 12+ Months

Client: Loblolly/State of Texas

Job ID: TDCJ (DMND0015529)

Job Description:
We are seeking a highly skilled and experienced professional to lead the design, implementation, and management of end-to-end enterprise-grade data solutions. This role involves expertise in building and optimizing data warehouses, data lakes, and lakehouse platforms, with a strong emphasis on data engineering, data science, and machine learning. You will work closely with cross-functional teams to create scalable and robust architectures that support advanced analytics and machine learning use cases while adhering to industry standards and best practices. Responsibilities Include:

  • Architect, design, and manage the entire data lifecycle from data ingestion, transformation, storage, and processing to advanced analytics and machine learning data bases and large-scale processing systems.
  • Implement robust data governance frameworks, including metadata management, lineage tracking, security, compliance, and business glossary development.
  • Identify, design, and implement internal process improvements, including redesigning infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
  • Ensure high data quality and reliability through automated data validation and testing and provide high quality clean, and usable data from data sets of varying states of disorder.
  • Develop and enforce architecture standards, patterns, and reference models for large-scale data platforms.
  • Architect and implement Lambda and Kappa architectures for real-time and batch data processing workflows along with strong data modeling capabilities.
  • Ability to identify and implement the most appropriate data management system and enable integration capabilities for external tools to perform ingestion, compilation, analytics and visualization.

Job Qualifications

  1. Ability to define and manage data flows and data pipelines with related scripting knowledge for importing;
  2. Strong data modeling capabilities;
  3. Ability to identify and implement the most appropriate data management system;
  4. Provide high quality clean and usable data from data sets of varying states of disorder;
  5. Data/Query validation proficiency; and
  6. Demonstrate a wide range of technical competencies including tools such as; SAP, Oracle, Cassandra, MySQL, Redis, PostgreSQL, MongoDB, and Hive.

REQUIRED SKILLS

Technical Expertise:

  • Proficient in SQL, Python, and big data processing frameworks (e.g., Spark, Flink).
  • Strong experience with cloud platforms (AWS, Azure, GCP) and related data services.
  • Hands-on experience with data warehousing tools (e.g., Snowflake, Redshift, BigQuery) , Databricks running on multiple cloud platforms (AWS, Azure and GCP) and data lake technologies (e.g., S3, ADLS, HDFS).
  • Expertise in containerization and orchestration tools like Docker and Kubernetes.
  • Knowledge of MLOps frameworks and tools (e.g., MLflow, Kubeflow, Airflow).
  • Experience with real-time streaming architectures (e.g., Kafka, Kinesis).
  • Familiarity with Lambda and Kappa architectures for data processing.
  • Enable integration capabilities for external tools to perform ingestion, compilation, analytics and visualization.

PREFERRED SKILLS

  • Certifications in cloud platforms or data-related technologies.
  • Familiarity with graph databases, NoSQL, or time-series databases.
  • Knowledge of data privacy regulations (e.g., GDPR, CCPA) and compliance requirements.
  • Experience in implementing and managing business glossaries, data governance rules, metadata lineage, and ensuring data quality.
  • Highly experienced with AWS cloud platform and Databricks lakehouse.
  • Education: Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.

Job Tags

Remote job,

Similar Jobs

Umanist Staffing LLC

Registered Nurse (RN) Job at Umanist Staffing LLC

Job Summary: We are seeking a compassionate and skilled Registered Nurse (RN) to join our healthcare team in Dexter, MO. As an RN, you will provide high-quality, patient-centered care to individuals in a variety of settings, ensuring optimal health and recovery outcomes... 

National Fitness Center

Childcare Attendant Job at National Fitness Center

 ...Job Summary: The Childcare Attendants are stationed in the Childcare area of the Fitness Center, and must always remain there when children...  ...their children. Therefore, we must always strive to ensure the safety and well-being of the children and put the members at ease with... 

Sagency

Director of Events Job at Sagency

 ...DIRECTOR OF EVENTS NATE: The Communications Infrastructure Contractors Association Remote within South Dakota About NATE NATE: The Communications Infrastructure Contractors Association is a non-profit trade association serving the tower and communications... 

Domino's Franchise

Delivery Driver - 159th St Orland Hills Job at Domino's Franchise

 ...Drivers are expected to obey all Rules of the Road. We demand that drivers use smart hustle for gathering your orders and getting to your car and the customers door from your car. Safety is always our top concern. Applicant must be ready to come to work with a smile, and be... 

Hyatt

Elaia Spa - Massage Therapist (On Call) Job at Hyatt

 ...Summary Join us for an incredible opportunity to be a part of our ElaiaSpa as an On Call Massage Therapist. The Elaia Spa Massage Therapist will provide an exceptional experience to the guests of Hyatt at Olive 8 . Elaia Spa supports a true connection between...