Data Lake TesterCompu-Vision Consulting • Boston, MA, United States
Data Lake Tester
Compu-Vision Consulting • Boston, MA, United States
30+ days ago
Job type
- Full-time
Job descriptionEnsuring the accuracy and completeness of data ingested into the data lake. Validating data transformations and ETL (Extract, Transform, Load) processes to ensure data is correctly processed and stored. Performing data quality checks to identify and resolve data anomalies and inconsistencies. Developing comprehensive test plans and test cases based on data requirements, use cases, and business rules. Designing automated tests to validate data ingestion, transformation, storage, and retrieval processes. Collaborating with data engineers and data architects to understand data pipelines and data flow. Writing and maintaining scripts and automated tests to perform data validation and testing. Using testing frameworks and tools to automate data testing processes, such as Apache Nifi, Talend, or custom scripts in Python / Scala. Conducting performance testing to ensure the data lake can handle large volumes of data and high transaction rates. Testing the scalability and performance of data ingestion, querying, and processing. Ensuring data security and privacy by validating access controls, encryption, and data masking. Verifying compliance with relevant data protection regulations and standards. Testing the integration of the data lake with upstream and downstream systems, such as data sources, data warehouses, and BI tools. Ensuring seamless data flow and integration between different components of the data architecture. Identifying defects and issues in the data lake and working with development teams to resolve them. Documenting defects, performing root cause analysis, and tracking them to closure. Creating and maintaining detailed test documentation, including test plans, test cases, test scripts, and test results. Reporting test progress, results, and quality metrics to stakeholders. Continuously improving testing processes and methodologies to enhance the efficiency and effectiveness of data testing. Staying updated with the latest tools, technologies, and best practices in data testing and data management.
Title : Data Lake Tester
Contract Length : 06 months
Location : Remote
Job Description :
- A Data Lake Tester plays a crucial role in ensuring the integrity, performance, and reliability of data stored in a data lake. Here are the key responsibilities and roles of a Data Lake Tester : A Data Lake Tester ensures that the data lake is robust, reliable, and ready to support data-driven decision-making and analytics.
Data Validation and Verification :
Test Planning and Design :
Automation and Scripting :
Performance Testing :
Security and Compliance :
Integration Testing :
Defect Identification and Resolution :
Documentation and Reporting :
Continuous Improvement :
Create a job alert for this search
Lake • Boston, MA, United States
Related jobs
A company is looking for a QA Analyst focused on Android.Key Responsibilities Execute manual test cases for new features, bug fixes, and regression testing on Android applications Perform functi...Show more A company is looking for a Software Test Engineer to ensure the quality of agricultural equipment software programs.Key Responsibilities Create and implement test procedures for vehicle displays,...Show more 
Rochester Electronics is hiring immediately for Electronic Tester I | 2nd Shift.Temporary position with the potential for conversion to a permanent role within 30 to 60 days.As an Electronic Tester...Show more A company is looking for a Lead QA Analyst to oversee the quality assurance process across projects.Key Responsibilities Lead and mentor the QA team to ensure adherence to best practices in testi...Show more A company is looking for an Automation Tester to support a federal partner in a remote capacity.Key Responsibilities Develop and maintain automated testing frameworks using Selenium / Appium and sc...Show more A company is looking for a Senior QA Engineer - Site Lead.Key Responsibilities Lead and manage the QA team to ensure quality standards are met Develop and implement testing strategies and proces...Show more A company is looking for a Manual QA Engineer to support quality assurance activities for projects involving Adobe Experience Manager and Adobe Workfront Fusion integrations.Key Responsibilities ...Show more A company is looking for a Strong Middle QA Engineer for a healthcare project on a part-time basis.Key Responsibilities Review requirements to ensure clarity and testability Design and execute m...Show more A company is looking for an ETL Test Engineer to join their Data Testing team.Key Responsibilities Design, develop, and execute ETL test strategies and test cases for data validation Perform dat...Show more A company is looking for a QA Test Automation Engineer.Key Responsibilities Design, develop, and maintain automated API test suites for geospatial APIs and microservices Collaborate with cross-f...Show more A company is looking for a Test Engineer.Key Responsibilities Analyzes user / business software system requirements and writes appropriate test cases Ensures proper execution of test scripts and d...Show more A company is looking for a Freelance Chemistry Expert - Quality Assurance (AI Trainer).Key Responsibilities Create and refine content to ensure accuracy and relevance in Chemistry Assess qualifi...Show more A company is looking for a QA & Proofreader to enhance content quality and ensure accuracy.Key Responsibilities : Proofread and rewrite video titles and descriptions for accuracy and engagement R...Show more A company is looking for a Test Analyst (SDET) - Automation.Key Responsibilities Assist the agile team in defining testable work to achieve desired customer experiences and outcomes Promote cont...Show more A company is looking for a Test Lead - Manual.Key Responsibilities Engage with stakeholders to understand requirements and prepare test scenarios and cases Execute test cases and manage defects ...Show more A company is looking for a QA Test Lead.Key Responsibilities Lead the entire QA lifecycle, from test strategy definition to deployment sign-off Design and execute test plans for validating new S...Show more A company is looking for a Test & Evaluation Specialist to support software testing and evaluation in a remote setting.Key Responsibilities Produce and maintain quality test scripts, collaboratin...Show more A company is looking for a Middle Manual QA for the Payments Team.Key Responsibilities Analyzing and processing requirements and testing web and native applications Creating and executing test c...Show more
QA Analyst, Android
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 1 day ago • Promoted
Software Test Engineer
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 30+ days ago • Promoted
Electronic Tester I
Rochester Electronics L • Newburyport, MA, US
Full-time +1
Last updated: 1 day ago • Promoted
Lead QA Analyst
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 20 hours ago • Promoted • New!
Automation Tester
VirtualVocations • Dorchester, Massachusetts, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior QA Engineer
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 30+ days ago • Promoted
Manual QA Engineer
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 30+ days ago • Promoted
Middle QA Engineer
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 30+ days ago • Promoted
ETL Test Engineer
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 1 day ago • Promoted
QA Test Automation Engineer
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 30+ days ago • Promoted
QA Test Engineer
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 30+ days ago • Promoted
Chemistry QA Specialist
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 2 days ago • Promoted
QA Proofreader
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 6 days ago • Promoted
Test Analyst Automation
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 5 hours ago • Promoted • New!
Manual Testing Lead
VirtualVocations • Dorchester, Massachusetts, United States
Full-time
Last updated: 21 days ago • Promoted
California Licensed QA Test Lead
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 6 days ago • Promoted
Test & Evaluation Specialist
VirtualVocations • Lowell, Massachusetts, United States
Full-time
Last updated: 6 days ago • Promoted
Middle Manual QA Tester
VirtualVocations • Dorchester, Massachusetts, United States
Full-time
Last updated: 5 days ago • Promoted