What is the significance of A/B testing in ML software engineering?
A/B testing is used to measure the impact of changes in the user interface of a ML application.
A/B testing helps in optimizing the hyperparameters of a machine learning model.
A/B testing is irrelevant in ML software engineering.
A/B testing helps in evaluating the performance and effectiveness of different machine learning models.
A/B testing in an ML engineering context is a controlled experimental methodology where two (or more) model variants — for example, a current production model (A) and a candidate replacement (B) — are deployed simultaneously to randomly assigned, statistically comparable segments of live traffic, and their real-world performance is compared on business or task-relevant metrics (conversion rate, click-through rate, task accuracy, latency-adjusted engagement). This provides causal evidence of which model performs better under actual production conditions, which offline evaluation on static held-out datasets cannot fully capture, since production data distributions shift and downstream user behavior interacts with model outputs in ways offline metrics miss.
Option A narrows A/B testing incorrectly to UI changes alone; while A/B testing originated in and remains common for UI/UX experimentation, its application in ML engineering explicitly extends to comparing model versions, algorithms, and feature sets — not just interface elements. Option B misattributes a distinct methodology (systematic hyperparameter search, covered in the previous question) to A/B testing, which evaluates already-trained model variants rather than searching a hyperparameter space. Option C is simply incorrect — A/B testing is a cornerstone of responsible ML deployment and MLOps practice, gating rollout decisions before full production release.
For building a zero-shot image classification pipeline, what could be a crucial step in the process?
Focusing on enhancing the resolution and quality of images before classification.
Manually labeling each image in the dataset for precise classification.
Using a model like CLIP for encoding both images and their textual descriptions into a shared representation space for comparison.
Designing an algorithm to replace the need for textual descriptions in the classification process.
Zero-shot image classification, by definition, requires classifying images into categories the model was never explicitly trained to recognize, with no task-specific labeled examples. CLIP-style models enable this by encoding both images and candidate text labels (e.g., "a photo of a {class}") into a shared embedding space; classification then reduces to a similarity comparison — computing cosine similarity between the image embedding and each candidate text embedding and selecting the closest match. This is the crucial architectural step: without a shared embedding space linking visual and textual semantics, there is no mechanism to generalize to unseen classes using only their names or descriptions.
Option B directly contradicts the "zero-shot" premise — manual labeling of the target dataset is precisely what zero-shot classification is designed to avoid; if labels were being collected for the target classes, the task would be standard supervised classification, not zero-shot. Option A (image enhancement) may marginally help downstream accuracy but is not the crucial, defining step. Option D is incoherent with how CLIP-style zero-shot classification actually works — the textual description of each candidate class is the essential input that makes zero-shot generalization possible; eliminating it would remove the mechanism entirely, not improve it.
Which visualization technique is suitable for representing the distribution of performance scores for different multimodal ML models over different modalities?
Heatmap
Histogram
Box plot
Pie chart
A box plot (box-and-whisker plot) summarizes the distribution of a numeric variable — median, interquartile range, and outliers — as a single compact glyph, and critically, multiple box plots can be placed side by side to compare distributions across categorical groupings. This makes it well suited to the scenario described: comparing the spread and central tendency of performance scores across several models, further faceted by modality, in one readable figure. Box plots make skew, variance, and outlier prevalence immediately comparable across groups in a way a single summary statistic (like mean accuracy) cannot.
A histogram (B) shows the distribution of a single variable well but does not scale cleanly to side-by-side comparison across many model/modality combinations without becoming visually cluttered. A heatmap (A) is excellent for showing a matrix of values (e.g., mean score per model × modality pair) but represents point estimates, not distributions — it cannot convey variance or spread. A pie chart (D) is inappropriate for any continuous performance metric.
In practice, a violin plot — which overlays a kernel density estimate on the box plot's summary statistics — is often preferred when the underlying distribution's shape (e.g., bimodality) matters, but among the given options, the box plot is the correct choice for distributional comparison across groups.
You have been given a dataset with missing values. What is the first step you should take with the data?
Analyze the patterns and distribution of missing values.
Remove the rows with missing values.
Fill in the missing values with a default value.
Remove the columns with missing values.
Before deciding *how* to handle missing data, best practice requires understanding *why* it's missing — analyzing whether missingness is Missing Completely at Random (MCAR, no systematic pattern), Missing at Random (MAR, related to other observed variables but not the missing value itself), or Missing Not at Random (MNAR, related to the missing value itself, e.g., patients with severe symptoms being less likely to complete a survey field). This diagnostic step determines which downstream handling strategy is statistically appropriate: naive row deletion under MNAR conditions can introduce systematic bias into the remaining dataset, while mean/median imputation applied blindly can distort variance and correlational structure if missingness isn't actually random.
Options B, C, and D each jump directly to a specific remedial action without first establishing whether that action is appropriate for the missingness pattern present. Removing rows (B) sacrifices sample size and can bias results if missingness correlates with the outcome of interest. Filling with a default value (C) without understanding the pattern risks introducing artificial structure that doesn't reflect the true underlying data. Removing entire columns (D) may discard genuinely informative features if missingness in that column is low or non-systematic.
Only after this initial pattern analysis should you select an appropriate strategy: listwise deletion, mean/median/mode imputation, model-based imputation (e.g., MICE, k-NN imputation), or explicit missingness indicators as additional features.
What is contrastive learning in the context of multimodal deep learning? Pick the 2 correct responses below.
Contrastive learning is a technique used to manipulate and analyze multimodal data using Generative AI.
In a multimodal context, usually, contrastive learning increases the similarity of representations across modalities for the different objects and decreases the similarity of representations across modalities for same objects.
In a multimodal context, usually, contrastive learning decreases the similarity of representations across modalities for the same objects and increases the similarity of representations across modalities for different objects.
Contrastive learning is a technique used to train deep learning models by comparing similar and dissimilar inputs and optimizing the model to maximize the similarity between representations of similar inputs and minimize the similarity between representations of dissimilar inputs.
In a multimodal context, usually, contrastive learning increases the similarity of representations across modalities for the same objects and decreases the similarity of representations across modalities for different objects.
Option D captures the general, task-agnostic definition of contrastive learning: given pairs of inputs labeled as similar (positive pairs) or dissimilar (negative pairs), the training objective pulls positive pairs' representations closer together in embedding space while pushing negative pairs' representations further apart — typically implemented via losses like InfoNCE, triplet loss, or contrastive loss with a margin. This is the mechanism underlying self-supervised representation learning broadly, not only in multimodal settings.
Option E correctly applies this general principle to the multimodal case: for the *same* object described across modalities (e.g., an image of a dog and the caption "a dog"), the model should increase representational similarity, since they refer to the same underlying entity; for *different* objects across modalities (an image of a dog paired with the caption "a cat"), the model should decrease similarity. This is exactly CLIP's training objective, tested elsewhere in this set — matching image-text pairs pulled together, mismatched pairs pushed apart.
Options B and C both invert this relationship — B increases similarity for *different* objects and decreases it for *same* objects, and C similarly reverses the correct direction — describing the opposite of what contrastive learning is designed to achieve, making both clearly incorrect distractors that test careful reading of directionality. Option A is too vague and mischaracterizes contrastive learning as a generative/manipulation technique rather than a representation-learning objective.
What is a common method to reduce the computational cost of deep learning models during inference?
Pruning weights or neurons.
Adding more convolutional filters.
By replacing activation functions in some neurons with simpler ones.
Increasing the batch size.
Pruning removes weights, neurons, or entire filters/channels that contribute minimally to model output — identified via magnitude-based criteria (removing near-zero weights), sensitivity analysis, or more sophisticated importance scoring — producing a smaller, sparser model that requires fewer computations and less memory at inference time while aiming to preserve accuracy through careful selection and, often, a fine-tuning step after pruning to recover any lost performance. Structured pruning (removing entire filters/channels) yields hardware-friendly speedups on standard accelerators, while unstructured pruning (removing individual weights) achieves higher sparsity ratios but requires specialized sparse-computation hardware or libraries to realize actual speed gains.
The remaining options move in the wrong direction or address a different concern: adding more convolutional filters (B) increases model capacity and parameter count, which increases computational cost, the opposite of the stated goal. Increasing batch size (D) affects training throughput and memory usage per step but does not reduce the per-sample computational cost of inference — a larger batch does more total work, not less per inference call, and batch size at inference is often constrained by latency requirements rather than optimization goals. Option C's premise — selectively replacing activation functions with simpler ones in "some neurons" — is not a standard or well-defined optimization technique; activation function choice is typically uniform within a layer and driven by training dynamics, not a piecemeal inference-cost lever.
Which of the following best describes the role of machine learning in handling multimodal data?
To focus on textual data analysis.
To reduce the amount of data needed for accurate predictions.
To eliminate the need for human intervention in data analysis.
To enable models to learn from and interpret diverse data types.
Machine learning's role in multimodal contexts is to build models capable of jointly learning from, aligning, and interpreting heterogeneous data types — text, images, audio, video, time series, and beyond — extracting patterns and relationships that span modality boundaries rather than treating each stream in isolation. This is the general framing that unifies the more specific concepts tested elsewhere in this domain (fusion strategies, shared embedding spaces, cross-modal attention): all of them are mechanisms in service of this broader goal of learning from diverse data types jointly.
Option A incorrectly narrows the scope to text alone, contradicting the entire premise of multimodal learning. Option B is not a defining characteristic — multimodal models often require *more*, not less, data to learn reliable cross-modal correspondences, though they can improve sample efficiency for a given task relative to a comparably-performing unimodal model by exploiting complementary signal across modalities; this is a possible benefit, not the defining role. Option C overstates ML's function; human oversight, labeling, validation, and bias auditing remain integral to responsible multimodal system development, particularly under Trustworthy AI principles — ML augments rather than eliminates human involvement in the broader data-analysis workflow.
Which of the following best describes the role of the Hugging Face model repository in ML software development?
A convenient tool for deploying neural networks for production-scale inference similar to Triton Server.
A library for customizing large language models like GPT, LLaMA-2, and Falcon using the NeMo framework.
A set of NVIDIA SDKs, such as Riva, NeMo, Triton, and ACE, for implementing neural network architectures.
A platform for sharing and accessing pre-trained models and transformers for natural language processing.
The Hugging Face Hub is a community-driven platform hosting hundreds of thousands of pretrained models — spanning NLP, computer vision, audio, and multimodal tasks — along with the accompanying `transformers` library that provides a standardized API to load, fine-tune, and run these models. Its role in the ML development workflow is discovery and access: developers can find a pretrained checkpoint suited to their task, download it with a few lines of code, and fine-tune or deploy it, dramatically lowering the barrier to applying transfer learning without training models from scratch.
This is explicitly distinct from deployment infrastructure: option A describes Triton Server's role (production-scale, multi-framework serving), a different layer of the ML stack than a model repository — Hugging Face models are commonly *exported to* and served *through* Triton in production pipelines, making them complementary rather than equivalent. Option B incorrectly ties Hugging Face specifically to NVIDIA's NeMo framework — Hugging Face is an independent, framework-agnostic ecosystem, not built on or limited to NeMo, though NeMo can import from and export to Hugging Face formats. Option C conflates Hugging Face with the NVIDIA SDK stack (Riva, NeMo, Triton, ACE) entirely — Hugging Face is not an NVIDIA product; it is a separate open-source and commercial company/platform in the ML ecosystem.
In the development of Trustworthy AI, what is the significance of 'Certification' as a principle?
It requires AI systems to be developed with an ethical consideration for societal impacts.
It ensures that AI systems are transparent in their decision-making processes.
It mandates that AI models comply with relevant laws and regulations specific to their deployment region and industry.
It involves verifying that AI models are fit for their intended purpose according to regional or industry-specific standards.
Within Trustworthy AI frameworks, "Certification" is best understood as the formal verification process confirming that an AI system meets defined standards of fitness-for-purpose — whether those standards are set by regulatory bodies, industry consortia, or internal governance frameworks — for the specific context in which the system will be deployed. This is distinct from, though related to, the broader Trustworthy AI principles of ethics (option A), transparency (option B), and legal compliance (option C): certification is the *verification mechanism* that attests a system satisfies applicable standards, rather than being one of those underlying values itself.
The distinction between C and D is subtle and worth being precise about: C describes compliance as an obligation ("must follow laws and regulations"), while D describes certification as a verification activity ("confirming fitness according to standards") — certification is the audit/attestation process, and compliance is one of the things that process may confirm. A system can be legally compliant without having undergone formal certification, and certification processes often assess criteria broader than legal compliance alone, including performance benchmarks, robustness testing, and domain-appropriate validation (e.g., clinical validation standards for a medical imaging model).
In practice, certification connects Trustworthy AI to concrete deployment gates: a healthcare AI model, for instance, may require certification against medical device standards before clinical use — the verification step, not merely the legal requirement, is the "Certification" principle's substance.
Which of the following best describes the purpose of GAN (Generative Adversarial Networks)?
To produce new data that is similar to the training data.
To optimize decision-making processes based on historical data.
To classify and categorize data based on patterns and features.
To optimize search algorithms for faster data retrieval.
A GAN consists of two networks trained in an adversarial minimax game: a generator that learns to produce synthetic samples from random noise, and a discriminator that learns to distinguish those generated samples from real training data. As training progresses, the generator improves at producing increasingly realistic samples in an attempt to fool the discriminator, while the discriminator improves at detecting fakes — at convergence (ideally), the generator produces samples statistically indistinguishable from the real training distribution. This generative objective — producing new, realistic data resembling the training distribution — is GAN's defining purpose, applied to images, audio, tabular data, and other domains.
The remaining options describe fundamentally different task categories that GANs are not designed for: decision optimization based on historical data (B) describes reinforcement learning or classical decision-theoretic optimization, not generative modeling. Classification and categorization (C) is a discriminative task — GANs' discriminator component performs a real-vs-fake discrimination internally as a training mechanism, but the discriminator is not GAN's end product or purpose; the generator is. Search algorithm optimization (D) is an information-retrieval concern entirely outside generative modeling's scope.
GANs are one of several generative model families tested in this domain alongside diffusion models (which power the U-Net-based denoising questions elsewhere in this set) and variational autoencoders, each with different training dynamics and stability characteristics.
In convolutional neural networks, we may use padding in both convolution and transposed convolution. Which two (2) statements accurately describe padding in convolution and transposed convolution? Pick the 2 correct responses below.
Padding in convolution increases the spatial dimensions of the input feature map, while padding in transposed convolution decreases the spatial dimensions of the output feature maps.
In a convolution operation, padding is added to the output after it has been expanded with the stride. On the other hand, in a transposed convolution operation, padding is added to the input before it is expanded with stride.
Padding in convolution enables convolution operations on the boundary pixels of the input. In transposed convolution, it removes rows and columns along the perimeter of the input after it is expanded with stride.
Padding in convolution and transposed convolution serve the same purpose of reducing the convolutional neural network's memory requirement and computational cost of the convolutional neural network.
Padding in convolution is used only when the input image is smaller than the filter size, while padding in transposed convolution is used only when the input image is larger than the filter size.
Padding behaves in a genuinely counter-intuitive, and often confused, way between standard convolution and transposed convolution, which is exactly why this pairing is tested together. In standard convolution, adding padding to the input before the kernel slides across it effectively increases the input's spatial extent, which — for a fixed kernel size and stride — increases (or, in "same" padding, preserves) the resulting output feature map's spatial dimensions relative to the unpadded case; padding this way also allows the kernel to be centered properly over boundary/edge pixels, which would otherwise be under-sampled compared to interior pixels (option C's first half).
In transposed convolution (sometimes called "deconvolution," used for upsampling in decoder/generator architectures), padding operates on the *output* side after the input has already been expanded by inserting stride-related spacing between elements: the padding parameter specifies how many rows/columns to *remove* from the perimeter of that expanded, computed output — meaning padding in transposed convolution shrinks rather than grows the resulting output dimensions, the reverse of its effect in standard convolution. This gives option A's directional claim and option C's second half.
Option B reverses which operation padding applies to (input vs. output) for each case. Option D is incorrect — padding's purpose is spatial-dimension and boundary handling, not memory/compute reduction (padding, if anything, typically adds slightly more computation). Option E states an artificial, non-standard usage rule that doesn't reflect how padding is actually applied in practice.
You want to evaluate the performance of an AI model. Which of the following is a method for AI model evaluation?
Interviewing the developers of the AI model to assess its performance.
Calculating the model's accuracy from randomly selected data points from the dataset not used during the model's training.
Randomly selecting data points from the training set and calculating the accuracy of the model on these data points.
Calculating the loss function of the model on the training set.
Valid model evaluation requires measuring performance on held-out data the model has not seen during training — this is the foundational principle behind train/validation/test splits and cross-validation, and it exists specifically to estimate how the model will generalize to genuinely new data, rather than how well it memorized patterns specific to its training set. Option B correctly describes this: sampling from a portion of the dataset explicitly excluded from training and calculating accuracy on it.
Options C and D both violate this principle by evaluating on the training set itself, which produces optimistically biased performance estimates: a model — particularly an overparameterized deep learning model — can achieve very high training accuracy or very low training loss simply by memorizing training examples (overfitting) without that performance transferring to new data at all. Reporting training-set accuracy (C) or training-set loss (D) as an evaluation of "performance" conflates fit-to-training-data with generalization, the central failure mode that held-out evaluation is designed to catch. Option A describes a qualitative, subjective process — interviewing developers — that provides no quantitative, reproducible performance measurement and is not a recognized model evaluation methodology.
This principle extends further in rigorous experimentation: a validation set used repeatedly for hyperparameter tuning can itself become "leaked" through repeated selection, which is why a separate, untouched test set is typically reserved for final, one-time performance reporting.
In experimentation, how does data augmentation contribute to improving model accuracy?
It helps in increasing the size of the dataset, leading to better generalization of the model.
It reduces the complexity of the model, making it easier to train and evaluate.
It has no impact on model accuracy and is primarily used for data visualization purposes.
It improves the interpretability of the model by providing additional insights into the data.
Data augmentation applies label-preserving transformations to existing training examples — rotation, flipping, cropping, color jitter, and noise injection for images; back-translation, synonym substitution, and random masking for text; time-stretching, pitch-shifting, and noise addition for audio — to synthetically expand the effective size and diversity of a training dataset without collecting new labeled data. This exposes the model to a wider range of input variations it may encounter at inference time, reducing overfitting to the specific characteristics of the original, smaller dataset and improving generalization to unseen data. This is particularly valuable in domains where labeled data is expensive or scarce to collect, including many multimodal settings.
Options B, C, and D each misattribute augmentation's mechanism or effect: augmentation does not reduce model complexity (B) — it operates entirely on the data, leaving model architecture and parameter count unchanged, and can in some cases make optimization more demanding due to increased input variability. It is not merely a visualization tool with no accuracy impact (C) — this directly contradicts augmentation's well-established, empirically demonstrated role as a regularization technique. And while augmented data can occasionally surface edge cases during error analysis, augmentation's primary purpose is not interpretability (D) — techniques like SHAP, LIME, or attention visualization address interpretability directly, a separate concern from dataset expansion.
What characteristic of autoencoders makes them suitable for anomaly detection?
Their capacity to learn a compressed representation of the data.
Their ability to classify images with high accuracy.
Their function in enhancing the quality of images.
Their capability to predict future outcomes based on past data.
An autoencoder learns to compress input data into a lower-dimensional latent (bottleneck) representation via its encoder, then reconstruct the original input from that representation via its decoder, trained by minimizing reconstruction error on normal data. Because the model is optimized specifically to reconstruct patterns it has seen frequently during training, it becomes proficient at compressing and reconstructing "normal" instances but performs poorly — producing high reconstruction error — on inputs that deviate structurally from the training distribution, i.e., anomalies. Thresholding reconstruction error thus provides a natural, unsupervised anomaly score without requiring labeled anomalous examples, which are often scarce or unavailable in real-world settings.
This mechanism is the operative characteristic tested here, not classification accuracy (B, which describes a supervised discriminative task the autoencoder is not directly trained for), image enhancement (C, a description closer to denoising autoencoders' side effect rather than the core anomaly-detection mechanism), or forecasting (D, which describes sequence models like RNNs/LSTMs applied to time series, a different architecture family and objective).
Variants such as variational autoencoders (VAEs) extend this idea probabilistically, and in multimodal settings, cross-modal autoencoders can flag anomalies where reconstruction fails to reconcile one modality given another.
You are working with a large dataset and want to visualize the distribution of a continuous variable. Which type of data visualization would be most appropriate?
Histogram chart
Bar chart
Line chart
Pie chart
A histogram bins a continuous variable into contiguous intervals and plots the frequency (or density) of observations falling into each bin, making it the standard tool for visualizing the shape of a continuous distribution — skewness, modality, spread, and outliers are all immediately visible. This distinguishes it from a bar chart (B), which is designed for discrete or categorical variables where bars are separated and ordering is often arbitrary; applying a bar chart to continuous data loses the notion of a numeric scale between categories.
A line chart (C) is appropriate for showing trends of a variable across an ordered sequence, typically time, not for summarizing the overall shape of a value distribution. A pie chart (D) shows proportions of a whole across categorical segments and becomes visually unreadable and statistically meaningless for continuous data with many possible values.
In practice, histogram bin width is a critical hyperparameter: too few bins oversmooth the distribution and hide multimodality, while too many bins introduce noise. Tools like Freedman-Diaconis or Sturges' rule provide principled starting points, and kernel density estimates (KDE) are often overlaid as a smoothed alternative when bin-width sensitivity is a concern.
How is the optimization of a multimodal model different from a unimodal model in terms of gradient vanishing?
Unimodal models have a higher risk of gradient vanishing compared to multimodal models, as the focus on a single modality allows for better gradient flow and stability.
Multimodal models have a higher risk of gradient vanishing compared to unimodal models, as the combination of multiple modalities increases the complexity of the model architecture.
Both multimodal and unimodal models have an equal risk of gradient vanishing, as the optimization process is independent of the number of modalities.
Gradient vanishing is not a concern in either multimodal or unimodal models, as modern optimization techniques have overcome this issue.
Multimodal architectures are generally deeper and structurally more complex than their unimodal counterparts: they typically combine multiple modality-specific encoder branches (each potentially deep in its own right, e.g., a vision transformer plus a language transformer) with additional fusion layers stacked on top. This increased effective depth and the heterogeneous gradient paths flowing back through fusion points create more opportunities for gradients to shrink as they propagate backward through many successive layers and combination operations — the classic vanishing gradient problem, where early layers receive vanishingly small weight updates and effectively stop learning. Imbalanced convergence rates across modality branches (one modality dominating gradient signal while another stagnates) is a related, multimodal-specific optimization challenge that compounds this risk.
This doesn't mean unimodal models are immune to vanishing gradients — they clearly are not, which is precisely why techniques like residual connections, normalization layers, and careful initialization were developed for deep unimodal networks in the first place. But the *comparative* claim in this question — that multimodal architectures face elevated risk due to added structural complexity — reflects a genuine, actively researched challenge in multimodal optimization, addressed through techniques like modality-specific learning rates, gradient blending, and careful fusion-layer design.
Copyright © 2021-2026 CertsTopics. All Rights Reserved