Ensure Solution Quality

• Ensure Portability & Flexibility: The considerations for this domain include the design for application and data portability, including data residency prerequisites and Multiple-Cloud. It also coves data staging, discovery, and cataloging, as well as mapping to future and current business prerequisites.
• Ensure Fidelity & Reliability: The applicants should be able to carry out data preparation & quality control (such as Cloud Dataprep), verify and monitor, as well as plan, execute, and stress test data recovery (including rerunning failed jobs, fault tolerance, and retrospective re-analysis performance). Besides that, they should be able to choose between idempotent ACID and eventual consistent prerequisites;
• Ensure Efficiency & Scalability: The potential candidates will be required to demonstrate their ability to build and run test suits as well as monitor pipeline, including Stackdriver. It also focuses on their skills related to assessing, improving, and troubleshooting data process infrastructure and data representations. This area will also require that the test takers demonstrate the capacity to resize and autoscale resources;
• Design for Compliance & Security: The consideration for this topic includes identity & access management such as Cloud IAM. You should also know about data security (including key management and encryption) and privacy assurance (such as Data Loss Prevention API). This part also covers the skills needed in legal compliance, including Health Insurance Portability & Accountability Act, FedRAMP, Children’s Online Privacy Protection Act, and General Data Protection Regulation;

Data Engineering on Google Cloud course

It is a 4-day course that gives hands-on experience to the candidates and allows them to build data processing systems on Google Cloud. It will also show you how to design data processing systems, analyze data and build end-to-end data pipelines and machine learning. In order to get a better understanding of the course, you need to complete the big data machine learning course or get equivalent experience. This course also aids you in developing applications using a programming language such as Python and covers the following objective:

• Processing batch and streaming data by using autoscaling data pipelines on Cloud Dataflow
• Enable insights from streaming data
• Predicting machine models using TensorFlow and Cloud ML
• Designing and building data processing systems on the Google Cloud Platform
• Influencing unstructured data using ML APIs on Cloud Dataproc

Understanding functional and technical aspects of Google Professional Data Engineer Exam Ensuring solution quality

The following will be discussed here:

• Designing for data and application portability (e.g., multi-cloud, data residency requirements)
• Data security (encryption, key management)
• Legal compliance (e.g., Health Insurance Portability and Accountability Act (HIPAA), Children's Online Privacy Protection Act (COPPA), FedRAMP, General Data Protection Regulation (GDPR))
• Mapping to current and future business requirements
• Identity and access management (e.g.,Cloud IAM)
• Ensuring reliability and fidelity
• Resizing and autoscaling resources
• Performing data preparation and quality control (e.g., Cloud Dataprep)
• Assessing, troubleshooting, and improving data representations and data processing infrastructure
• Building and running test suites
• Ensuring flexibility and portability
• Ensuring scalability and efficiency
• Pipeline monitoring (e.g., Stackdriver)
• Planning, executing, and stress testing data recovery (fault tolerance, rerunning failed jobs, performing retrospective re-analysis)
• Data staging, cataloging, and discovery
• Verification and monitoring
• Ensuring privacy (e.g., Data Loss Prevention API)
• Choosing between ACID, idempotent, eventually consistent requirements
• Designing for security and compliance

Google Professional-Data-Engineer Exam Syllabus Topics:

Reference: https://cloud.google.com/certification/data-engineer