What is contrastive learning in the context of multimodal deep learning? Pick the 2 correct responses below.
Contrastive learning is a technique used to manipulate and analyze multimodal data using Generative AI.
In a multimodal context, usually, contrastive learning increases the similarity of representations across modalities for the different objects and decreases the similarity of representations across modalities for same objects.
In a multimodal context, usually, contrastive learning decreases the similarity of representations across modalities for the same objects and increases the similarity of representations across modalities for different objects.
Contrastive learning is a technique used to train deep learning models by comparing similar and dissimilar inputs and optimizing the model to maximize the similarity between representations of similar inputs and minimize the similarity between representations of dissimilar inputs.
In a multimodal context, usually, contrastive learning increases the similarity of representations across modalities for the same objects and decreases the similarity of representations across modalities for different objects.
Option D captures the general, task-agnostic definition of contrastive learning: given pairs of inputs labeled as similar (positive pairs) or dissimilar (negative pairs), the training objective pulls positive pairs' representations closer together in embedding space while pushing negative pairs' representations further apart — typically implemented via losses like InfoNCE, triplet loss, or contrastive loss with a margin. This is the mechanism underlying self-supervised representation learning broadly, not only in multimodal settings.
Option E correctly applies this general principle to the multimodal case: for the *same* object described across modalities (e.g., an image of a dog and the caption "a dog"), the model should increase representational similarity, since they refer to the same underlying entity; for *different* objects across modalities (an image of a dog paired with the caption "a cat"), the model should decrease similarity. This is exactly CLIP's training objective, tested elsewhere in this set — matching image-text pairs pulled together, mismatched pairs pushed apart.
Options B and C both invert this relationship — B increases similarity for *different* objects and decreases it for *same* objects, and C similarly reverses the correct direction — describing the opposite of what contrastive learning is designed to achieve, making both clearly incorrect distractors that test careful reading of directionality. Option A is too vague and mischaracterizes contrastive learning as a generative/manipulation technique rather than a representation-learning objective.
Which of the following is a component of the Content Authenticity Initiative?
Content validity
Ethical AI development
Data encryption
Content credential
The Content Authenticity Initiative (CAI) — the cross-industry effort NVIDIA participates in alongside Adobe, Microsoft, and other organizations, built on the C2PA (Coalition for Content Provenance and Authenticity) open technical standard — centers on "Content Credentials": tamper-evident metadata attached to digital content that records its provenance, including how, when, and with what tools (including generative AI systems) the content was created or edited. Content Credentials travel with the media file and can be cryptographically verified, giving viewers a way to trace an image or video's origin and edit history, which is increasingly important as generative AI makes synthetic media harder to distinguish from authentic content by inspection alone.
The other options are either too generic or describe adjacent-but-distinct concepts: "content validity" (A) is not a defined CAI technical component; it reads as a plausible-sounding but non-specific distractor. "Ethical AI development" (B) describes a broader Trustworthy AI value that CAI's work supports and relates to, but it is not itself a named CAI component or deliverable. "Data encryption" (C) is a general information-security technique — CAI's Content Credentials do use cryptographic signing to ensure tamper-evidence, but encryption (confidentiality) and the CAI's actual mechanism (verifiable, signed provenance metadata) are distinct concepts; CAI is about disclosure and traceability, not concealment.
What characteristic of autoencoders makes them suitable for anomaly detection?
Their capacity to learn a compressed representation of the data.
Their ability to classify images with high accuracy.
Their function in enhancing the quality of images.
Their capability to predict future outcomes based on past data.
An autoencoder learns to compress input data into a lower-dimensional latent (bottleneck) representation via its encoder, then reconstruct the original input from that representation via its decoder, trained by minimizing reconstruction error on normal data. Because the model is optimized specifically to reconstruct patterns it has seen frequently during training, it becomes proficient at compressing and reconstructing "normal" instances but performs poorly — producing high reconstruction error — on inputs that deviate structurally from the training distribution, i.e., anomalies. Thresholding reconstruction error thus provides a natural, unsupervised anomaly score without requiring labeled anomalous examples, which are often scarce or unavailable in real-world settings.
This mechanism is the operative characteristic tested here, not classification accuracy (B, which describes a supervised discriminative task the autoencoder is not directly trained for), image enhancement (C, a description closer to denoising autoencoders' side effect rather than the core anomaly-detection mechanism), or forecasting (D, which describes sequence models like RNNs/LSTMs applied to time series, a different architecture family and objective).
Variants such as variational autoencoders (VAEs) extend this idea probabilistically, and in multimodal settings, cross-modal autoencoders can flag anomalies where reconstruction fails to reconcile one modality given another.
You are working with a large dataset and want to visualize the distribution of a continuous variable. Which type of data visualization would be most appropriate?
Histogram chart
Bar chart
Line chart
Pie chart
A histogram bins a continuous variable into contiguous intervals and plots the frequency (or density) of observations falling into each bin, making it the standard tool for visualizing the shape of a continuous distribution — skewness, modality, spread, and outliers are all immediately visible. This distinguishes it from a bar chart (B), which is designed for discrete or categorical variables where bars are separated and ordering is often arbitrary; applying a bar chart to continuous data loses the notion of a numeric scale between categories.
A line chart (C) is appropriate for showing trends of a variable across an ordered sequence, typically time, not for summarizing the overall shape of a value distribution. A pie chart (D) shows proportions of a whole across categorical segments and becomes visually unreadable and statistically meaningless for continuous data with many possible values.
In practice, histogram bin width is a critical hyperparameter: too few bins oversmooth the distribution and hide multimodality, while too many bins introduce noise. Tools like Freedman-Diaconis or Sturges' rule provide principled starting points, and kernel density estimates (KDE) are often overlaid as a smoothed alternative when bin-width sensitivity is a concern.
Assume you need to implement a multimodal pipeline to diagnose brain cancer type using MRI scans and their corresponding radiology reports. What do you need to include in the ablation study?
Directly combining MRI scans and radiology reports into a single input stream without preprocessing or modality-specific adjustments.
Implementing separate unimodal pipelines for each modality to ensure the data is informative and the model design is accurate.
More advanced natural language processing techniques to interpret radiology reports, ignoring the MRI scans' diagnostic value.
Training a deep learning model using the images in the dataset to find outliers and enhancing the quality of MRI scans using image processing techniques.
An ablation study systematically removes or isolates individual components of a system to measure each one's individual contribution to overall performance. In a multimodal pipeline combining MRI scans and radiology reports, a proper ablation study requires training and evaluating separate unimodal pipelines — an image-only model on MRI scans alone, and a text-only model on radiology reports alone — alongside the full multimodal pipeline. Comparing these unimodal baselines against the combined system's performance is what actually demonstrates whether fusion is adding genuine diagnostic value beyond what either modality provides independently, and it surfaces whether one modality is doing most of the work while the other contributes marginally (or is even introducing noise) — critical information for both model design decisions and clinical validation in a high-stakes diagnostic context.
Option A describes an early-fusion design choice, not an ablation methodology — it's a modeling decision, not a validation technique for understanding component contribution. Option C proposes abandoning one modality's diagnostic value entirely, which undermines rather than tests the multimodal hypothesis. Option D describes data quality/preprocessing work relevant earlier in the pipeline, not the comparative, component-isolating structure that defines an ablation study.
In a clinical context specifically, this ablation approach is also essential for regulatory and interpretability purposes — demonstrating that a diagnostic claim rests on genuine cross-modal signal, not a spurious correlation from a single dominant input.
What is the purpose of a kernel in a Convolutional Neural Network (CNN)?
To perform convolution operations on input data.
To calculate the loss function.
To classify the data into different categories.
To normalize the input data.
A kernel (or filter) in a CNN is a small matrix of learnable weights that slides across the input (an image, feature map, or intermediate activation) computing a dot product at each spatial position — the convolution operation. Each kernel is trained to detect a specific local pattern: early-layer kernels typically learn to detect low-level features like edges and color gradients, while kernels in deeper layers combine these into detectors for more complex, higher-level patterns (textures, object parts, and eventually whole-object representations as receptive fields grow with depth). A convolutional layer typically applies many kernels in parallel, each producing its own output channel, collectively forming the layer's feature map.
The other options describe separate CNN components with distinct responsibilities: the loss function (B) is computed at the network's output based on the difference between predictions and ground truth, entirely separate from the kernel's role in feature extraction. Classification (C) is typically performed by fully connected (dense) layers — often with a softmax activation — placed after the convolutional feature-extraction stack, not by the kernels themselves. Normalization (D) is handled by dedicated layers such as batch normalization or layer normalization, inserted between convolutional layers to stabilize activations, again a separate mechanism from the convolution operation itself.
Which metric is commonly used for evaluating Automatic Speech Recognition (ASR) models?
CTC Loss
F1 Score
Mean Opinion Score (MOS)
Word Error Rate (WER)
Word Error Rate is the standard evaluation metric for ASR systems. It measures the edit distance between the model's transcription and a human reference transcript, computed as (Substitutions + Deletions + Insertions) / Number of reference words, expressed as a percentage. Lower WER indicates better transcription accuracy. Its character-level analogue, Character Error Rate (CER), is used for languages without clear word boundaries or for morphologically complex languages.
The distractors target common confusions: CTC (Connectionist Temporal Classification) Loss (A) is a *training* objective used to align variable-length audio input with variable-length text output in ASR models like DeepSpeech — it optimizes the model but is not itself a post-hoc evaluation metric on held-out accuracy. F1 Score (B) evaluates classification tasks with defined positive/negative classes, such as keyword spotting or wake-word detection, not full transcription. Mean Opinion Score (C) is a subjective, human-rated metric used to evaluate speech *synthesis* quality (TTS) or perceived audio naturalness — the inverse task of ASR — not transcription accuracy.
On NVIDIA's Riva and NeMo ASR pipelines, WER is the benchmark reported against datasets like LibriSpeech, and it remains the figure typically referenced in the exam's Multimodal Data and Experimentation domains when discussing speech model evaluation.
In LLM evaluation, what does “zero-shot learning” refer to?
The model's ability to learn from zero examples
A technique to reduce training time to zero
The model's performance after extensive training
The model's ability to perform tasks it has not been explicitly trained on
Zero-shot learning describes a model's capacity to correctly perform a task it was never explicitly trained or fine-tuned on, relying instead on knowledge and generalization ability acquired during broader pretraining. For LLMs, this typically means the model is given only a natural-language instruction or prompt describing the task — with no task-specific labeled examples provided in the prompt at all — and is expected to produce a reasonable response by generalizing from its pretraining. This is directly analogous to CLIP's zero-shot image classification (covered elsewhere in this set): a model trained broadly can be applied to a new, specific task purely through how the task is described to it, without additional task-specific training.
Option A is a subtly incorrect paraphrase: zero-shot learning is not about the model "learning from zero examples" during a training process — it's about applying a model that was never trained for the specific task at all, at inference time. The model isn't learning in the zero-shot moment; it's generalizing from prior training. Option B misapplies "zero" to training time rather than to task-specific examples — an unrelated concept. Option C directly contradicts the definition; zero-shot specifically refers to performance *without* task-specific training, not performance *after* extensive training on that task.
Zero-shot is typically contrasted with few-shot learning, where a small number of task-specific examples are included in the prompt to guide the model's response without updating its weights.
In large-language models, what is the purpose of the attention mechanism?
To measure the importance of the words in the output sequence.
To assign weights to each word in the input sequence.
To determine the order in which words are generated.
To capture the order of the words in the input sequence.
The attention mechanism computes a set of weights over the tokens in the input (or context) sequence for each step of processing, reflecting how relevant each input token is to the computation currently being performed — for instance, how relevant each word in a source sentence is to correctly translating a given target word, or how relevant each prior token is to predicting the next one in an autoregressive model. Mechanically, this is computed via query, key, and value projections: a query (representing the current focus) is compared against keys (representing each input token) to produce attention scores, which are normalized (typically via softmax) into weights and used to compute a weighted sum over the corresponding values — allowing the model to dynamically focus more on relevant tokens and less on irrelevant ones, rather than treating all input tokens with equal importance.
Option D describes positional encoding's role (covered directly in an earlier question in this set) — capturing token order — which is a distinct mechanism from attention; attention operates on token *content and relevance*, while positional encoding separately supplies *order* information as an input feature, since self-attention itself is permutation-invariant without it. Option A misdirects the weighting toward the output sequence specifically, when attention weights are computed primarily over the input/context tokens being attended to. Option C describes the decoding/generation procedure (autoregressive sampling), not attention's mechanism.
How is the optimization of a multimodal model different from a unimodal model in terms of gradient vanishing?
Unimodal models have a higher risk of gradient vanishing compared to multimodal models, as the focus on a single modality allows for better gradient flow and stability.
Multimodal models have a higher risk of gradient vanishing compared to unimodal models, as the combination of multiple modalities increases the complexity of the model architecture.
Both multimodal and unimodal models have an equal risk of gradient vanishing, as the optimization process is independent of the number of modalities.
Gradient vanishing is not a concern in either multimodal or unimodal models, as modern optimization techniques have overcome this issue.
Multimodal architectures are generally deeper and structurally more complex than their unimodal counterparts: they typically combine multiple modality-specific encoder branches (each potentially deep in its own right, e.g., a vision transformer plus a language transformer) with additional fusion layers stacked on top. This increased effective depth and the heterogeneous gradient paths flowing back through fusion points create more opportunities for gradients to shrink as they propagate backward through many successive layers and combination operations — the classic vanishing gradient problem, where early layers receive vanishingly small weight updates and effectively stop learning. Imbalanced convergence rates across modality branches (one modality dominating gradient signal while another stagnates) is a related, multimodal-specific optimization challenge that compounds this risk.
This doesn't mean unimodal models are immune to vanishing gradients — they clearly are not, which is precisely why techniques like residual connections, normalization layers, and careful initialization were developed for deep unimodal networks in the first place. But the *comparative* claim in this question — that multimodal architectures face elevated risk due to added structural complexity — reflects a genuine, actively researched challenge in multimodal optimization, addressed through techniques like modality-specific learning rates, gradient blending, and careful fusion-layer design.
What is a main application of Triton Inference Server?
Triton Server can be used to generate images from pure noise.
Triton Server can be used to deploy AI models on the GPU only.
Triton Server can be used to execute GPU-accelerated graph analysis with cuGraph.
Triton Server can be used to deploy neural networks from various frameworks.
NVIDIA Triton Inference Server is an open-source model-serving platform designed to standardize production deployment across heterogeneous model formats and hardware backends. Its defining capability is multi-framework support: a single Triton instance can concurrently serve models trained in TensorFlow, PyTorch, ONNX Runtime, TensorRT, OpenVINO, and custom Python/C++ backends, exposing them through unified HTTP/REST and gRPC inference APIs. This eliminates the need for framework-specific serving stacks and lets teams standardize deployment infrastructure independent of how a given model was trained.
Option B is a common but incorrect assumption — Triton explicitly supports both GPU and CPU inference, which matters for cost-sensitive or edge deployments where GPU availability is limited. Option C confuses Triton with cuGraph, a separate RAPIDS library for GPU-accelerated graph analytics (unrelated to model serving), and option A describes a generative task (denoising diffusion), which is a *model capability*, not a Triton *server* function — Triton can host such a model, but "generating images from noise" is not what the server itself does.
Triton also provides dynamic batching, concurrent model execution, model ensembling (chaining pre/post-processing with inference), and metrics export — features tested elsewhere in the Software Development and Engineering and Performance Optimization domains.
You have been given a dataset with missing values. What is the first step you should take with the data?
Analyze the patterns and distribution of missing values.
Remove the rows with missing values.
Fill in the missing values with a default value.
Remove the columns with missing values.
Before deciding *how* to handle missing data, best practice requires understanding *why* it's missing — analyzing whether missingness is Missing Completely at Random (MCAR, no systematic pattern), Missing at Random (MAR, related to other observed variables but not the missing value itself), or Missing Not at Random (MNAR, related to the missing value itself, e.g., patients with severe symptoms being less likely to complete a survey field). This diagnostic step determines which downstream handling strategy is statistically appropriate: naive row deletion under MNAR conditions can introduce systematic bias into the remaining dataset, while mean/median imputation applied blindly can distort variance and correlational structure if missingness isn't actually random.
Options B, C, and D each jump directly to a specific remedial action without first establishing whether that action is appropriate for the missingness pattern present. Removing rows (B) sacrifices sample size and can bias results if missingness correlates with the outcome of interest. Filling with a default value (C) without understanding the pattern risks introducing artificial structure that doesn't reflect the true underlying data. Removing entire columns (D) may discard genuinely informative features if missingness in that column is low or non-systematic.
Only after this initial pattern analysis should you select an appropriate strategy: listwise deletion, mean/median/mode imputation, model-based imputation (e.g., MICE, k-NN imputation), or explicit missingness indicators as additional features.
Which of the following best describes the role of the Hugging Face model repository in ML software development?
A convenient tool for deploying neural networks for production-scale inference similar to Triton Server.
A library for customizing large language models like GPT, LLaMA-2, and Falcon using the NeMo framework.
A set of NVIDIA SDKs, such as Riva, NeMo, Triton, and ACE, for implementing neural network architectures.
A platform for sharing and accessing pre-trained models and transformers for natural language processing.
The Hugging Face Hub is a community-driven platform hosting hundreds of thousands of pretrained models — spanning NLP, computer vision, audio, and multimodal tasks — along with the accompanying `transformers` library that provides a standardized API to load, fine-tune, and run these models. Its role in the ML development workflow is discovery and access: developers can find a pretrained checkpoint suited to their task, download it with a few lines of code, and fine-tune or deploy it, dramatically lowering the barrier to applying transfer learning without training models from scratch.
This is explicitly distinct from deployment infrastructure: option A describes Triton Server's role (production-scale, multi-framework serving), a different layer of the ML stack than a model repository — Hugging Face models are commonly *exported to* and served *through* Triton in production pipelines, making them complementary rather than equivalent. Option B incorrectly ties Hugging Face specifically to NVIDIA's NeMo framework — Hugging Face is an independent, framework-agnostic ecosystem, not built on or limited to NeMo, though NeMo can import from and export to Hugging Face formats. Option C conflates Hugging Face with the NVIDIA SDK stack (Riva, NeMo, Triton, ACE) entirely — Hugging Face is not an NVIDIA product; it is a separate open-source and commercial company/platform in the ML ecosystem.
You want to evaluate the performance of an AI model. Which of the following is a method for AI model evaluation?
Interviewing the developers of the AI model to assess its performance.
Calculating the model's accuracy from randomly selected data points from the dataset not used during the model's training.
Randomly selecting data points from the training set and calculating the accuracy of the model on these data points.
Calculating the loss function of the model on the training set.
Valid model evaluation requires measuring performance on held-out data the model has not seen during training — this is the foundational principle behind train/validation/test splits and cross-validation, and it exists specifically to estimate how the model will generalize to genuinely new data, rather than how well it memorized patterns specific to its training set. Option B correctly describes this: sampling from a portion of the dataset explicitly excluded from training and calculating accuracy on it.
Options C and D both violate this principle by evaluating on the training set itself, which produces optimistically biased performance estimates: a model — particularly an overparameterized deep learning model — can achieve very high training accuracy or very low training loss simply by memorizing training examples (overfitting) without that performance transferring to new data at all. Reporting training-set accuracy (C) or training-set loss (D) as an evaluation of "performance" conflates fit-to-training-data with generalization, the central failure mode that held-out evaluation is designed to catch. Option A describes a qualitative, subjective process — interviewing developers — that provides no quantitative, reproducible performance measurement and is not a recognized model evaluation methodology.
This principle extends further in rigorous experimentation: a validation set used repeatedly for hyperparameter tuning can itself become "leaked" through repeated selection, which is why a separate, untouched test set is typically reserved for final, one-time performance reporting.
In the transformer architecture, what is the purpose of positional encoding?
To encode the semantic meaning of each token in the input sequence.
To add information about the order of each token in the input sequence.
To remove redundant information from the input sequence.
To encode the importance of each token in the input sequence.
Unlike recurrent architectures, which process tokens sequentially and thereby inherently encode order through the sequence of computation, the transformer's self-attention mechanism processes all tokens in parallel and is permutation-invariant by construction — attention scores between tokens do not inherently depend on their position in the sequence. Positional encoding solves this by injecting explicit information about each token's position into its input representation, typically by adding a positional vector (computed via fixed sinusoidal functions in the original "Attention Is All You Need" formulation, or learned as trainable embeddings in many modern variants) to the token's embedding before it enters the attention layers. Without this, "the cat sat on the mat" and "the mat sat on the cat" would be indistinguishable to the self-attention mechanism, since the same set of token embeddings would be processed identically regardless of order.
Semantic meaning (option A) is the role of the token embeddings themselves, learned separately from positional information — the two are combined (typically summed) but serve distinct purposes. Positional encoding does not remove information (C); it adds it. And while attention weights do effectively encode a learned notion of token importance relative to a query (option D), that importance-weighting mechanism is a separate, downstream function of the attention layers, not the role of positional encoding itself, which only supplies order information as an input feature.
What are some methods to overcome limited throughput between CPU and GPU?
Increase the clock speed of the CPU.
Increase the number of CPU cores.
Using techniques like memory pooling.
Upgrade the GPU to a higher-end model.
CPU-GPU data transfer over the PCIe (or NVLink) bus is frequently a throughput bottleneck in ML pipelines, particularly when small, frequent transfers dominate rather than large batched ones — each transfer incurs fixed overhead independent of data size, so many small transfers waste a disproportionate amount of time on overhead rather than useful data movement. Memory pooling techniques — pre-allocating and reusing pinned (page-locked) host memory buffers rather than repeatedly allocating and freeing memory for each transfer — reduce this overhead and enable faster, more predictable DMA transfers between host and device. Related software-level techniques include using CUDA streams to overlap data transfer with computation (so the GPU keeps computing while the next batch transfers in the background), and batching transfers to amortize fixed per-transfer overhead across more data.
Options A, B, and D each propose hardware upgrades that address a different bottleneck than the one described: increasing CPU clock speed (A) or core count (B) improves CPU-side compute throughput, not the data-transfer bandwidth or latency between CPU and GPU specifically. Upgrading the GPU (D) increases GPU compute capability but does nothing to address a PCIe/interconnect bandwidth limitation — a faster GPU sitting idle waiting for data across the same bottlenecked bus would not see meaningfully improved end-to-end throughput. The question specifically asks about *throughput between* CPU and GPU, which points to interconnect/transfer-management optimization rather than raw compute upgrades on either side.
Copyright © 2021-2026 CertsTopics. All Rights Reserved