The #1 Site for IT and Engineering Jobs - search all IT and Engineering  jobs.

Data Quality Engineer

Job Description

Summary of Duties and Responsibilities

We are seeking a self-motivated Data QA Engineer to lead the testing framework design, development, automation for our Big data infrastructure leveraging the latest technologies from Microsoft Azure, both on-premise and in the cloud. This position requires API testing and automation of data pipelines, data services, cloud data warehouses, business intelligence, and machine learning platforms, especially around unified transactional data. The ideal candidate is a passionate and highly skilled individual who can utilize programming languages and analytics tools/technologies to validate products, machine learning models, data pipelines, and data deliverables.

Essential Functions

  • Build and maintain automated testing frameworks for big data environments that are highly secure, scalable, flexible, predictive analytics, and performant using C#, Python, and SQL technologies.
  • Develop test strategies, plans, test cases, and engineering best practices related to software test engineering, manual and automated testing, with a specific focus on data quality.
  • Lead data governance and data profiling efforts to ensure data quality and proper meta data documentation for data lineage.
  • Creating quality metrics to evaluate data pipelines, products, and customer deliverables.
  • Participate in and contribute to design and code reviews.
  • Knowledge of statistical methods, models, and processes and develop automated testing solutions to validate the predicted outcome.
  • Ability to work within an iterative software development lifecycle, under Agile development processes
  • Work with other developers to design and implement data science features in support of established security and acceptance criteria in collaboration with product owners.
  • Proficiency with common software engineering best practices, such as pairing, test-driven development (TDD), writing unit and integration tests, and participating in code reviews.
  • Work with engineers, designers, and analysts to deliver innovative AI/ML product feature enhancements.
  • Assist the QA team with feature and regression testing for feature acceptance.
  • Provide excellent written and verbal communication.


Skills/Competencies

  • 7+ years of professional coding experience in C#, Java, JavaScript, Python, or Ruby – Preferred C#.
  • 7+ years of design and implementing Test Automation frameworks using C#, Python, node.js, SQL, javascript, and React JS
  • 7+ years of experience using any of the following IDE or BBD tools (SpecFlow, Cucumber, Visual Studio, Visual Studio Code, etc.)
  • 7+ years of hands-on working experience of testing REST, Web APIs or SOAP APIs (ASP.Net, MSTest, NUnit, Postman, and SoapUI)
  • 5+ years of experience in data integration (ETL/ELT) / data engineering in a near real-time data warehouse environment
  • 5+ years of experience in data modeling and distributed data architecture
  • Experience with visualization tools such as Power BI, Tableau, SpotFire, TIBCO, QlikView, MicroStrategy, Information Builders, and other reporting and analytical tools
  • Familiarity with data sets in myriad of formats and storage technologies/databases such as HDFS, Avro, CSV, JSON
  • Hands-on testing experience in working Microsoft Big data architecture and technologies
  • Awareness of tools used in the manipulation of large, complex datasets for use in analytic use cases.


Education

  • Bachelor’s or Master’s degree in Computer Science or related field such as Mathematics and Statistics, preferably with a focus on data analytics.

Job Requirements

 

Job Snapshot

Location US-GA-Nationwide
Employment Type Full-Time
Pay Type Year
Pay Rate N/A
Store Type Engineering & Aerospace
Apply

Company Overview

The CSI Companies

The CSI Companies and its four divisions provide national staffing solutions by placing top talent in the technology, financial, accounting, healthcare, and other professional industries across the country. The CSI Companies are part of Recruit Global Staffing, active in Asia, Europe, North America and Oceania. Recruit Global Staffing is a leading global HR service provider, part of Recruit Holdings Co., Ltd. To learn more about The CSI Companies, visit thecsicompanies.com. Learn More

Contact Information

US-GA-Nationwide
Snapshot
The CSI Companies
Company:
US-GA-Nationwide
Location:
Full-Time
Employment Type:
Year
Pay Type:
N/A
Pay Rate:
Engineering & Aerospace
Store Type:

Job Description

Summary of Duties and Responsibilities

We are seeking a self-motivated Data QA Engineer to lead the testing framework design, development, automation for our Big data infrastructure leveraging the latest technologies from Microsoft Azure, both on-premise and in the cloud. This position requires API testing and automation of data pipelines, data services, cloud data warehouses, business intelligence, and machine learning platforms, especially around unified transactional data. The ideal candidate is a passionate and highly skilled individual who can utilize programming languages and analytics tools/technologies to validate products, machine learning models, data pipelines, and data deliverables.

Essential Functions

  • Build and maintain automated testing frameworks for big data environments that are highly secure, scalable, flexible, predictive analytics, and performant using C#, Python, and SQL technologies.
  • Develop test strategies, plans, test cases, and engineering best practices related to software test engineering, manual and automated testing, with a specific focus on data quality.
  • Lead data governance and data profiling efforts to ensure data quality and proper meta data documentation for data lineage.
  • Creating quality metrics to evaluate data pipelines, products, and customer deliverables.
  • Participate in and contribute to design and code reviews.
  • Knowledge of statistical methods, models, and processes and develop automated testing solutions to validate the predicted outcome.
  • Ability to work within an iterative software development lifecycle, under Agile development processes
  • Work with other developers to design and implement data science features in support of established security and acceptance criteria in collaboration with product owners.
  • Proficiency with common software engineering best practices, such as pairing, test-driven development (TDD), writing unit and integration tests, and participating in code reviews.
  • Work with engineers, designers, and analysts to deliver innovative AI/ML product feature enhancements.
  • Assist the QA team with feature and regression testing for feature acceptance.
  • Provide excellent written and verbal communication.


Skills/Competencies

  • 7+ years of professional coding experience in C#, Java, JavaScript, Python, or Ruby – Preferred C#.
  • 7+ years of design and implementing Test Automation frameworks using C#, Python, node.js, SQL, javascript, and React JS
  • 7+ years of experience using any of the following IDE or BBD tools (SpecFlow, Cucumber, Visual Studio, Visual Studio Code, etc.)
  • 7+ years of hands-on working experience of testing REST, Web APIs or SOAP APIs (ASP.Net, MSTest, NUnit, Postman, and SoapUI)
  • 5+ years of experience in data integration (ETL/ELT) / data engineering in a near real-time data warehouse environment
  • 5+ years of experience in data modeling and distributed data architecture
  • Experience with visualization tools such as Power BI, Tableau, SpotFire, TIBCO, QlikView, MicroStrategy, Information Builders, and other reporting and analytical tools
  • Familiarity with data sets in myriad of formats and storage technologies/databases such as HDFS, Avro, CSV, JSON
  • Hands-on testing experience in working Microsoft Big data architecture and technologies
  • Awareness of tools used in the manipulation of large, complex datasets for use in analytic use cases.


Education

  • Bachelor’s or Master’s degree in Computer Science or related field such as Mathematics and Statistics, preferably with a focus on data analytics.

Job Requirements

 
M3p6cx74hfk1v3gdkzk
Sologig Advice

For your privacy and protection, when applying to a job online: Never give your social security number to a prospective employer, provide credit card or bank account information, or perform any sort of monetary transaction.Learn More

By applying to a job using sologig.com you are agreeing to comply with and be subject to the workinretail.com Terms and Conditions for use of our website. To use our website, you must agree with theTerms & Conditionsand both meet and comply with their provisions.
Data Quality Engineer Apply now