Neural data-to-text is the approach of using neural network models for generating natural language from structured data — employing deep learning architectures (Transformers, sequence-to-sequence models, pre-trained language models) to convert tables, records, and structured inputs into fluent, accurate text, representing the modern paradigm for automated data verbalization.

What Is Neural Data-to-Text?

• Definition: Neural network-based generation of text from structured data.
• Input: Structured data (tables, key-value pairs, records).
• Output: Natural language descriptions of the data.
• Distinction: Replaces traditional pipeline (content selection → planning → realization) with end-to-end neural models.

Why Neural Data-to-Text?

• Fluency: Neural models produce more natural, varied text.
• End-to-End: Single model replaces complex multi-stage pipeline.
• Adaptability: Fine-tune to new domains with parallel data.
• Quality: Matches or exceeds human-written text in fluency.
• Scalability: Train once, generate for any input in that domain.

Evolution of Approaches

Rule/Template-Based (Pre-Neural):

• Hand-crafted rules and templates for each domain.
• Reliable but rigid, repetitive, and expensive to create.
• Required separate modules for each pipeline stage.

Early Neural (2015-2018):

• Seq2Seq with attention (LSTM/GRU encoder-decoder).
• Copy mechanism for rare words and data values.
• Content selection via attention over input data.

Transformer Era (2018-2021):

• Pre-trained Transformers (BART, T5) fine-tuned for data-to-text.
• Table-aware pre-training (TAPAS, TaPEx, TUTA).
• Much better fluency and content coverage.

LLM Era (2022+):

• Large language models (GPT-4, Claude, Llama) with prompting.
• Few-shot and zero-shot data-to-text.
• In-context learning with table/data in prompt.

Key Neural Architectures

Encoder-Decoder:

• Encoder: Process structured data (linearized or structured encoding).
• Decoder: Autoregressive text generation.
• Attention: Attend to relevant data during generation.
• Copy Mechanism: Directly copy data values to output.

Pre-trained Language Models:

• T5: Text-to-text framework — linearize table as input text.
• BART: Denoising autoencoder — strong for generation tasks.
• GPT-2/3/4: Autoregressive LMs — in-context learning.
• Benefit: Pre-trained language knowledge improves fluency.

Table-Specific Models:

• TAPAS: Pre-trained on tables + text jointly.
• TaPEx: Pre-trained via table SQL execution.
• TUTA: Tree-based pre-training on table structure.
• Benefit: Better understanding of table structure.

Critical Challenge: Hallucination

Problem: Neural models generate fluent text that includes facts NOT in the input data.

Types:

• Intrinsic Hallucination: Contradicts input data (wrong numbers, names).
• Extrinsic Hallucination: Adds information not in input data.

Mitigation:

• Constrained Decoding: Restrict output to tokens appearing in input.
• Copy Mechanism: Encourage copying data values rather than generating.
• Faithfulness Rewards: RLHF or reward models penalizing hallucination.
• Post-Hoc Verification: Check generated text against input data.
• Data Augmentation: Train with negative examples of hallucination.
• Retrieval-Augmented: Ground generation in retrieved data.

Training & Techniques

• Supervised Fine-Tuning: Train on (data, text) pairs.
• Reinforcement Learning: Optimize for faithfulness and quality metrics.
• Few-Shot Prompting: Provide examples in LLM prompt.
• Chain-of-Thought: Reason about data before generating text.
• Data Augmentation: Generate synthetic training pairs.

Evaluation

• Automatic: BLEU, ROUGE, METEOR, BERTScore, PARENT.
• Faithfulness: PARENT (table-specific), NLI-based metrics.
• Human: Fluency, accuracy, informativeness, coherence.
• Task-Specific: Domain-appropriate metrics (e.g., sports accuracy).

Benchmarks

• ToTTo: Controlled table-to-text with highlighted cells.
• RotoWire: NBA box scores → game summaries.
• E2E NLG: Restaurant data → descriptions.
• WebNLG: RDF triples → text.
• WikiTableText: Wikipedia tables → descriptions.
• DART: Unified multi-domain benchmark.

Tools & Platforms

• Models: Hugging Face model hub (T5, BART, GPT fine-tuned).
• Frameworks: Transformers, PyTorch for training.
• Evaluation: GEM Benchmark for comprehensive evaluation.
• Production: Arria, Automated Insights for enterprise NLG.

Neural data-to-text represents the modern standard for automated text generation from data — combining the fluency of pre-trained language models with structured data understanding to produce natural, accurate narratives that make data accessible and actionable at scale.