INTERSPEECH-2023-Papers

Completed:

INTERSPEECH 2023 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023 conference. Explore the latest advances in speech and language processing. Code included. ⭐ the repository to support the advancement of speech technology!

👉 * This count includes repositories on GitHub, GitLab, Hugging Face, and distributions on PyPI, while excluding Web Page or GitHub Page links.

The PDF version of the INTERSPEECH 2023 Conference Programme, comprises a list of all accepted full papers, their presentation order, as well as the designated presentation times.

Other collections of the best AI conferences

❗ Conference table will be up to date all the time.

Contributors

Contributions to improve the completeness of this list are greatly appreciated. If you come across any overlooked papers, please feel free to create pull requests, open issues or contact me via email. Your participation is crucial to making this repository even better.

Papers

Resources for Spoken Language Processing

🆔	Title	Repo	Paper
1686	Multimodal Personality Traits Assessment (MuPTA) Corpus: The Impact of Spontaneous and Read Speech
1049	MOCKS 1.0: Multilingual Open Custom Keyword Spotting Testset
2150	MD3: The Multi-Dialect Dataset of Dialogues
2279	MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation
1828	Thai Dialect Corpus and Transfer-based Curriculum Learning Investigation for Dialect Automatic Speech Recognition	➖
2351	HK-LegiCoST: Leveraging Non-Verbatim Transcripts for Speech Translation	➖

Speech Synthesis: Prosody and Emotion

🆔	Title	Repo	Paper
749	Emotional Talking Head Generation based on Memory-Sharing and Attention-Augmented Networks	➖
1292	Speech Synthesis with Self-Supervisedly Learnt Prosodic Representations
1317	EmoMix: Emotion Mixing via Diffusion Models for Emotional Speech Synthesis	➖
806	Laughter Synthesis using Pseudo Phonetic Tokens with a Large-Scale In-the-Wild Laughter Corpus
2270	Explicit Intensity Control for Accented Text-to-Speech
834	Comparing Normalizing Flows and Diffusion Models for Prosody and Acoustic Modelling in Text-to-Speech	➖

Statistical Machine Translation

🆔	Title	Repo	Paper
2484	Modular Speech-to-Text Translation for Zero-Shot Cross-Modal Transfer	➖
1063	Improving Isochronous Machine Translation with Target Factors and Auxiliary Counters	➖
648	StyleS2ST: Zero-Shot Style Transfer for Direct Speech-to-Speech Translation
1767	Joint Speech Translation and Named Entity Recognition
2050	Analysis of Acoustic Information in End-to-End Spoken Language Translation	➖
2004	LAMASSU: A Streaming Language-Agnostic Multilingual Speech Recognition and Translation Model using Neural Transducers	➖

Self-Supervised Learning in ASR

🆔	Title	Repo	Paper
1213	DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models
1040	Automatic Data Augmentation for Domain Adapted Fine-Tuning of Self-Supervised Speech Representations
387	Dual Acoustic Linguistic Self-Supervised Representation Learning for Cross-Domain Speech Recognition	➖
2166	O-1: Self-Training with Oracle and 1-best Hypothesis	➖
822	MT4SSL: Boosting Self-Supervised Speech Representation Learning by Integrating Multiple Targets
1802	Comparing Self-Supervised Pre-Training and Semi-Supervised Training for Speech Recognition in Languages with Weak Language Models	➖

Prosody

🆔	Title	Repo	Paper
1781	Chinese EFL Learners' Perception of English Prosodic Focus	➖
315	Pitch Accent Variation and the Interpretation of Rising and Falling Intonation in American English	➖
1033	Tonal Coarticulation as a Cue for Upcoming Prosodic Boundary	➖
2116	Alignment of Beat Gestures and Prosodic Prominence in German	➖
1454	Creak Prevalence and Prosodic Context in Australian English	➖
1651	Speech Reduction: Position within French Prosodic Structure	➖

Speech Production

🆔	Title	Repo	Paper
637	Transvelar Nasal Coupling Contributing to Speaker Characteristics in Non-nasal Vowels	➖
286	Speech Synthesis from Articulatory Movements Recorded by Real-time MRI	➖
2283	The ART of Conversation: Measuring Phonetic Convergence and Deliberate Imitation in L2-Speech with a Siamese RNN
1933	Did You See that? Exploring the Role of Vision in the Development of Consonant Feature Contrasts in Children with Cochlear Implants	➖

Dysarthric Speech Assessment

🆔	Title	Repo	Paper
2017	Automatic Assessments of Dysarthric Speech: the Usability of Acoustic-Phonetic Features	➖
1455	Classification of Multi-class Vowels and Fricatives from Patients Having Amyotrophic Lateral Sclerosis with Varied Levels of Dysarthria Severity	➖
1627	Parameter-efficient Dysarthric Speech Recognition using Adapter Fusion and Householder Transformation	➖
2481	Few-Shot Dysarthric Speech Recognition with Text-to-Speech Data Augmentation	➖
1921	Latent Phrase Matching for Dysarthric Speech	➖
173	Speech Intelligibility Assessment of Dysarthric Speech by using Goodness of Pronunciation with Uncertainty Quantification

Speech Coding: Transmission

🆔	Title	Repo	Paper
1562	CQNV: A Combination of Coarsely Quantized Bitstream and Neural Vocoder for Low Rate Speech Coding	➖
1234	Target Speech Extraction with Conditional Diffusion Model	➖
883	Towards Fully Quantized Neural Networks For Speech Enhancement
980	Complex Image Generation SwinTransformer Network for Audio Denoising

Speech Recognition: Signal Processing, Acoustic Modeling, Robustness, Adaptation

🆔	Title	Repo	Paper
2118	Using Text Injection to Improve Recognition of Personal Identifiers in Speech	➖
837	Investigating Wav2Vec2 Context Representations and the Effects of Fine-Tuning, a Case-Study of a Finnish Model
872	Transformer-based Speech Recognition Models for Oral History Archives in English, German, and Czech	➖
177	Iteratively Improving Speech Recognition and Voice Conversion
2001	LABERT: A Combination of Local Aggregation and Self-Supervised Speech Representation Learning for Detecting Informative Hidden Units in Low-Resource ASR Systems	➖
746	TranUSR: Phoneme-to-Word Transcoder based Unified Speech Representation Learning for Cross-Lingual Speech Recognition	➖
1124	Dual-Mode NAM: Effective Top-K Context Injection for End-to-End ASR	➖
2417	GhostRNN: Reducing State Redundancy in RNN with Cheap Operations	➖
1442	Task-Agnostic Structured Pruning of Speech Representation Models	➖
485	Factual Consistency Oriented Speech Recognition	➖
1036	Multi-Head State Space Model for Speech Recognition	➖
341	Cascaded Multi-task Adaptive Learning based on Neural Architecture Search	➖
2359	Probing Self-Supervised Speech Models for Phonetic and Phonemic Information: A Case Study in Aspiration	➖
739	Selective Biasing with Trie-based Contextual Adapters for Personalised Speech Recognition using Neural Transducers	➖
213	A More Accurate Internal Language Model Score Estimation for the Hybrid Autoregressive Transducer	➖
106	Attention Gate between Capsules in Fully Capsule-Network Speech Recognition	➖
2585	OOD-Speech: A Large Bengali Speech Recognition Dataset for Out-of-Distribution Benchmarking
1316	ML-SUPERB: Multilingual Speech Universal PERformance Benchmark
2389	General-purpose Adversarial Training for Enhanced Automatic Speech Recognition Model Generalization	➖
275	Joint Instance Reconstruction and Feature Sub-space Alignment for Cross-Domain Speech Emotion Recognition	➖
2280	Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data	➖
1272	Random Utterance Concatenation based Data Augmentation for Improving Short-Video Speech Recognition	➖
1189	Adapter Incremental Continual Learning of Efficient Audio Spectrogram Transformers
223	Rethinking Speech Recognition with a Multimodal Perspective via Acoustic and Semantic Cooperative Decoding	➖
923	Improving Code-Switching and Name Entity Recognition in ASR with Speech Editing based Data Augmentation
2258	Bypass Temporal Classification: Weakly Supervised Automatic Speech Recognition with Imperfect Transcripts	➖
1184	DCCRN-KWS: An Audio Bias based Model for Noise Robust Small-Footprint Keyword Spotting	➖
1609	OTF: Optimal Transport based Fusion of Supervised and Self-Supervised Learning Models for Automatic Speech Recognition	➖
2136	Approximate Nearest Neighbour Phrase Mining for Contextual Speech Recognition	➖
788	Rehearsal-Free Online Continual Learning for Automatic Speech Recognition
496	ASR Data Augmentation in Low-Resource Settings using Cross-Lingual Multi-Speaker TTS and Cross-Lingual Voice Conversion
642	Personality-aware Training based Speaker Adaptation for End-to-End Speech Recognition
2257	Target Vocabulary Recognition based on Multi-task Learning with Decomposed Teacher Sequences	➖
679	Wave to Syntax: Probing Spoken Language Models for Syntax
720	Effective Training of Attention-based Contextual Biasing Adapters with Synthetic Audio for Personalised ASR	➖
630	Pushing the Limits of Unsupervised Unit Discovery for SSL Speech Representation	➖
1118	SlothSpeech: Denial-of-Service Attack Against Speech Recognition Models
503	CLRL-Tuning: A Novel Continual Learning Approach for Automatic Speech Recognition	➖
159	Exploring Sources of Racial Bias in Automatic Speech Recognition through the Lens of Rhythmic Variation	➖
1440	Can Contextual Biasing Remain Effective with Whisper and GPT-2?
221	Masked Modeling Duo for Speech: Specializing General-Purpose Audio Representation to Speech using Denoising Distillation
2207	Improving RNN Transducer Acoustic Models for English Conversational Speech Recognition	➖
1216	MixRep: Hidden Representation Mixup for Low-Resource Speech Recognition
1192	Improving Chinese Mandarin Speech Recognition using Graph Embedding Regularization	➖
1276	Adapting Multi-Lingual ASR Models for Handling Multiple Talkers	➖
1221	Adapter-Tuning with Effective Token-Dependent Representation Shift for Automatic Speech Recognition	➖
1010	Model-Internal Slot-Triggered Biasing for Domain Expansion in Neural Transducer ASR Models	➖
2508	Delay-Penalized CTC Implemented based on Finite State Transducer
2589	Vistaar: Diverse Benchmarks and Training Sets for Indian Language ASR
1091	Domain Adaptive Self-Supervised Training of Automatic Speech Recognition	➖
1105	There is more than One Kind of Robustness: Fooling Whisper with Adversarial Examples
1064	MT-SLVR: Multi-Task Self-Supervised Learning for Transformation In(Variant) Representations
1176	Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute	➖
759	Blank-Regularized CTC for Frame Skipping in Neural Transducer
2406	The Tag-Team Approach: Leveraging CLS and Language Tagging for Enhancing Multilingual ASR	➖
2354	Improving RNN-Transducers with Acoustic LookAhead	➖
1847	Everyone has an Accent	➖
2124	Some Voices are too Common: Building Fair Speech Recognition Systems using the Common-Voice Dataset	➖
1168	Information Magnitude based Dynamic Sub-Sampling for Speech-to-Text	➖
353	Towards Multi-task Learning of Speech and Speaker Recognition
2186	Regarding Topology and Variant Frame Rates for Differentiable WFST-based End-to-End ASR	➖
1012	2-bit Conformer Quantization for Automatic Speech Recognition	➖
167	Time-Domain Speech Enhancement for Robust Automatic Speech Recognition	➖
257	Multi-Channel Multi-Speaker Transformer for Speech Recognition	➖
733	Fake the Real: Backdoor Attack on Deep Speech Classification via Voice Conversion	➖
2463	Dialect Speech Recognition Modeling using Corpus of Japanese Dialects and Self-Supervised Learning-based Model XLSR	➖
767	Contextualized End-to-End Speech Recognition with Contextual Phrase Prediction Network	➖
970	Competitive and Resource Efficient Factored Hybrid HMM Systems are Simpler Than You Think	➖
791	MMSpeech: Multi-Modal Multi-Task Encoder-Decoder Pre-training for Speech Recognition	➖
2499	Biased Self-Supervised Learning for ASR	➖
1300	A Unified Recognition and Correction Model under Noisy and Accent Speech Conditions	➖
2470	Wav2Vec 2.0 ASR for Cantonese-Speaking Older Adults in a Clinical Setting	➖
770	BAT: Boundary aware Transducer for Memory-Efficient and Low-Latency ASR
1342	Bayes Risk Transducer: Transducer with Controllable Alignment Prediction
783	Multi-View Frequency-Attention Alternative to CNN Frontends for Automatic Speech Recognition	➖

Analysis of Speech and Audio Signals

🆔	Title	Repo	Paper
1173	Robust Prototype Learning for Anomalous Sound Detection	➖
982	A Multimodal Prototypical Approach for Unsupervised Sound Classification
563	Robust Audio Anti-Spoofing with Fusion-Reconstruction Learning on Multi-Order Spectrograms
1082	Adapting Language-Audio Models as Few-Shot Audio Learners
734	TFECN: Time-Frequency Enhanced ConvNet for Audio Classification	➖
350	Resolution Consistency Training on Time-Frequency Domain for Semi-Supervised Sound Event Detection	➖
1174	Fine-Tuning Audio Spectrogram Transformer with Task-Aware Adapters for Sound Event Detection	➖
1210	Small Footprint Multi-Channel Network for Keyword Spotting with Centroid based Awareness	➖
1380	Few-Shot Class-Incremental Audio Classification using Adaptively-Refined Prototypes	➖
1549	Interpretable Latent Space using Space-Filling Curves for Phonetic Analysis in Voice Conversion
1861	Topological Data Analysis for Speech Processing
1329	Recycle-and-Distill: Universal Compression Strategy for Transformer-based Speech SSL Models with Attention Map Reusing and Masking Distillation
932	Personalized Acoustic Scene Classification in Ultra-Low Power Embedded Devices using Privacy-Preserving Data Augmentation	➖
176	Background Domain Switch: A Novel Data Augmentation Technique for Robust Sound Event Detection
1021	Joint Prediction of Audio Event and Annoyance Rating in an Urban Soundscape by Hierarchical Graph Representation Learning
2416	Anomalous Sound Detection using Self-Attention-based Frequency Pattern Analysis of Machine Sounds	➖
1478	Improving Audio-Text Retrieval via Hierarchical Cross-Modal Interaction and Auxiliary Captions	➖
575	Differential Privacy enabled Dementia Classification: An Exploration of the Privacy-Accuracy Trade-off in Speech Signal Data	➖
1595	Learning Emotional Representations from Imbalanced Speech Data for Speech Emotion Recognition and Emotional Text-to-Speech
1816	Towards Multi-Lingual Audio Question Answering
1344	Blind Estimation of Room Impulse Response from Monaural Reverberant Speech with Segmental Generative Neural Network	➖
358	Emotion-aware Audio-Driven Face Animation via Contrastive Feature Disentanglement	➖
591	Anomalous Sound Detection based on Sound Separation	➖
2089	Random Forest Classification of Breathing Phases from Audio Signals Recorded using Mobile Devices	➖
1581	GRAVO: Learning to Generate Relevant Audio from Visual Features with Noisy Online Videos	➖
477	Wav2ToBI: A New Approach to Automatic ToBI Transcription
344	Joint-Former: Jointly Regularized and Locally Down-Sampled Conformer for Semi-Supervised Sound Event Detection
245	Towards Attention-based Contrastive Learning for Audio Spoof Detection	➖
2488	Masked Audio Modeling with CLAP and Multi-Objective Learning	➖
1904	Few-Shot Open-Set Learning for On-Device Customization of KeyWord Spotting Systems
481	Self-Supervised Dataset Pruning for Efficient Training in Audio Anti-Spoofing	➖
491	Semantic Segmentation with Bidirectional Language Models Improves Long-Form ASR	➖
684	Multi-Microphone Automatic Speech Segmentation in Meetings based on Circular Harmonics Features	➖
542	Advanced RawNet2 with Attention-based Channel Masking for Synthetic Speech Detection	➖
88	Insights Into End-to-End Audio-to-Score Transcription with Real Recordings: A Case Study with Saxophone Works	➖
2193	Whisper-AT: Noise-Robust Automatic Speech Recognizers are also Strong Audio Event Taggers
1621	Synthetic Voice Spoofing Detection based on Feature Pyramid Conformer	➖
1383	Learning a Self-Supervised Domain-Invariant Feature Representation for Generalized Audio Deepfake Detection	➖
2011	Application of Knowledge Distillation to Multi-Task Speech Representation Learning	➖
2297	DeCoR: Defy Knowledge Forgetting by Predicting Earlier Audio Codes	➖
1965	Variational Classifier for Unsupervised Anomalous Sound Detection under Domain Generalization	➖
745	FlexiAST: Flexibility is What AST Needs
1579	MCR-Data2vec 2.0: Improving Self-Supervised Speech Pre-training via Model-Level Consistency Regularization	➖
914	Visually-Aware Audio Captioning With Adaptive Audio-Visual Attention
165	Time-Frequency Domain Filter-and-Sum Network for Multi-Channel Speech Separation
801	Audio-Visual Fusion using Multiscale Temporal Convolutional Attention for Time-Domain Speech Separation	➖
1431	An Efficient Speech Separation Network based on Recurrent Fusion Dilated Convolution and Channel Attention	➖
2015	Binaural Sound Localization in Noisy Environments using Frequency-based Audio Vision Transformer (FAViT)	➖
1723	Contrastive Learning based Deep Latent Masking for Music Source Separation	➖
655	Speaker Extraction with Detection of Presence and Absence of Target Speakers	➖
889	PIAVE: A Pose-Invariant Audio-Visual Speaker Extraction Network	➖
2117	Spatial LibriSpeech: An Augmented Dataset for Spatial Audio Learning
1309	Image-Driven Audio-Visual Universal Source Separation	➖
2520	Joint Blind Source Separation and Dereverberation for Automatic Speech Recognition using Delayed-Subsource	➖
1766	SDNet: Stream-Attention and Dual-Feature Learning Network for Ad-hoc Array Speech Separation	➖
2451	Deeply Supervised Curriculum Learning for Deep Neural Network-based Sound Source Localization	➖
164	Multi-Channel Separation of Dynamic Speech and Sound Events
2545	Rethinking the Visual Cues in Audio-Visual Speaker Extraction
85	Using Semi-Supervised Learning for Monaural Time-Domain Speech Separation with a Self-Supervised Learning-based SI-SNR Estimator	➖
1158	Investigation of Training Mute-Expressive End-to-End Speech Separation Networks for an Unknown Number of Speakers	➖
2369	SR-SRP: Super-Resolution based SRP-PHAT for Sound Source Localization and Tracking	➖
613	Dual-Memory Multi-Modal Learning for Continual Spoken Keyword Spotting with Confidence Selection and Diversity Enhancement	➖
714	FN-SSL: Full-Band and Narrow-Band Fusion for Sound Source Localization
696	A Neural State-Space Modeling Approach to Efficient Speech Separation	➖
1777	Locate and Beamform: Two-Dimensional Locating All-Neural Beamformer for Multi-Channel Speech Separation
518	Monaural Speech Separation Method based on Recurrent Attention with Parallel Branches	➖
979	Ontology-Aware Learning and Evaluation for Audio Tagging
951	What do Self-Supervised Speech Representations Encode? An Analysis of Languages, Varieties, Speaking Styles and Speakers
1696	A Compressed Synthetic Speech Detection Method with Compression Feature Embedding	➖
572	Outlier-aware Inlier Modeling and Multi-Scale Scoring for Anomalous Sound Detection via Multitask Learning	➖
263	MOSLight: A Lightweight Data-Efficient System for Non-Intrusive Speech Quality Assessment	➖
1626	A Multi-Scale Attentive Transformer for Multi-Instrument Symbolic Music Generation
2494	MTANet: Multi-band Time-Frequency Attention Network for Singing Melody Extraction from Polyphonic Music
119	Xiaoicesing 2: A High-Fidelity Singing Voice Synthesizer based on Generative Adversarial Network
2190	Do Vocal Breath Sounds Encode Gender cues for Automatic Gender Classification?	➖
202	Automatic Exploration of Optimal Data Processing Operations for Sound Data Augmentation using Improved Differentiable Automatic Data Augmentation	➖
1430	A Snoring Sound Dataset for Body Position Recognition: Collection, Annotation, and Analysis
528	RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Music
832	Spatialization Quality Metric for Binaural Speech	➖
428	AsthmaSCELNet: A Lightweight Supervised Contrastive Embedding Learning Framework for Asthma Classification using Lung Sounds	➖
1426	Patch-Mix Contrastive Learning with Audio Spectrogram Transformer on Respiratory Sound Classification
2115	Remote Assessment for ALS using Multimodal Dialog Agents: Data Quality, Feasibility and Task Compliance	➖
852	AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image Generation
209	Obstructive Sleep Apnea Screening with Breathing Sounds and Respiratory Effort: A Multimodal Deep Learning Approach	➖
2275	Investigation of Music Emotion Recognition based on Segmented Semi-Supervised Learning	➖

Speech Recognition: Architecture, Search, and Linguistic Components

🆔	Title	Repo	Paper
2344	Diacritic Recognition Performance in Arabic ASR	➖
990	Personalization for BERT-based Discriminative Speech Recognition Rescoring	➖
2182	On the N-gram Approximation of Pre-trained Language Models	➖
2147	Record Deduplication for Entity Distribution Modeling in ASR Transcripts	➖
2205	Learning When to Trust Which Teacher for Weakly Supervised ASR	➖
1313	Text-Only Domain Adaptation using Unified Speech-Text Representation in Transducer	➖
1378	Text-Only Domain Adaptation for End-to-End Speech Recognition through Down-Sampling Acoustic Representation	➖
2479	Knowledge Distillation Approach for Efficient Internal Language Model Estimation	➖
276	Language Model Personalization for Improved Touchscreen Typing	➖
1223	Blank Collapse: Compressing CTC Emission for the Faster Decoding
403	Improving Joint Speech-Text Representations without Alignment	➖
1941	Leveraging Cross-Utterance Context for ASR Decoding	➖
423	Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation
1517	Integration of Frame- and Label-Synchronous Beam Search for Streaming Encoder-Decoder Speech Recognition	➖
1071	A Neural Time Alignment Module for End-to-End Automatic Speech Recognition	➖
599	Accelerating Transducers through Adjacent Token Merging	➖
617	Language-Universal Phonetic Representation in Multilingual Speech Pretraining for Low-Resource Speech Recognition	➖
2292	Language-Routing Mixture of Experts for Multi-Lingual and Code-Switching Speech Recognition	➖
1437	Embedding Articulatory Constraints for Low-Resource Speech Recognition based on Large Pre-trained Model	➖
2051	Exploration of Efficient End-to-End ASR using Discretized Input from Self-Supervised Learning	➖
768	SpellMapper: A Non-Autoregressive Neural Spellchecker for ASR Customization with Candidate Retrieval based on N-Gram Mappings
2037	Text Injection for Capitalization and Turn-Taking Prediction in Speech Models	➖
1281	Confidence-based Ensembles of End-to-End Speech Recognition Models
1050	Unsupervised Code-Switched Text Generation from Parallel Text	➖
258	A Binary Keyword Spotting System With Error-Diffusion Speech Feature Binarization	➖
621	Language-Universal Phonetic Encoder for Low-Resource Speech Recognition	➖
863	A Lexical-aware Non-Autoregressive Transformer-based ASR Model	➖
1841	Improving Under-Resourced Code-Switched Speech Recognition: Large Pre-trained Models or Architectural Interventions	➖
61	A Model for Every User and Budget: Label-Free and Personalized Mixed-Precision Quantization	➖
137	Modeling Dependent Structure for Utterances in ASR Evaluation	➖
757	ASR for Low Resource and Multilingual Noisy Code-Mixed Speech	➖
390	Accurate and Reliable Confidence Estimation based on Non-Autoregressive End-to-End Speech Recognition System	➖
737	Combining Multilingual Resources and Models to Develop State-of-the-Art E2E ASR for Swedish	➖
1171	Two Stage Contextual Word Filtering for Context bias in Unified Streaming and Non-Streaming Transducer	➖
1867	Towards Continually Learning New Languages	➖
1616	N-best T5: Robust ASR Error Correction using Multiple Input Hypotheses and Constrained Decoding Space	➖
1432	SememeASR: Boosting Performance of End-to-End Speech Recognition against Domain and Long-Tailed Data Shift with Sememe Semantic Knowledge	➖
1162	miniStreamer: Enhancing Small Conformer with Chunked-Context Masking for Streaming ASR Applications on the Edge	➖
1469	CoMFLP: Correlation Measure based Fast Search on ASR Layer Pruning
1337	Exploration on HuBERT with Multiple Resolution	➖
2045	Quantization-aware and Tensor-compressed Training of Transformers for Natural Language Understanding	➖
2355	Word-Level Confidence Estimation for CTC Models	➖
2235	Multilingual Contextual Adapters to Improve Custom Word Recognition in Low-Resource Languages	➖
614	Unsupervised Active Learning: Optimizing Labeling Cost-Effectiveness for Automatic Speech Recognition	➖
1303	4D ASR: Joint Modeling of CTC, Attention, Transducer, and Mask-Predict Decoders	➖
1086	Neural Model Reprogramming with Similarity based Mapping for Low-Resource Spoken Command Recognition
262	Language-Specific Boundary Learning for Improving Mandarin-English Code-Switching Speech Recognition	➖
480	Mixture-of-Expert Conformer for Streaming Multilingual ASR	➖
1665	Lossless 4-bit Quantization of Architecture Compressed Conformer ASR Systems on the 300-hr Switch-board Corpus	➖
2544	Compressed MoE ASR Model based on Knowledge Distillation and Quantization	➖

Speech Recognition: Technologies and Systems for New Applications

🆔	Title	Repo	Paper
2044	Syllable Discovery and Cross-Lingual Generalization in a Visually Grounded, Self-Supervised Speech Model
2032	Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization
235	Progress and Prospects for Spoken Language Technology: Results from Five Sexennial Surveys	➖
268	Acoustic Word Embeddings for Untranscribed Target Languages with Continued Pretraining and Learned Pooling	➖
601	CASA-ASR: Context-Aware Speaker-Attributed ASR	➖
1321	Unsupervised Learning of Discrete Latent Representations with Data-Adaptive Dimensionality from Continuous Speech Streams	➖
1167	AD-TUNING: An Adaptive CHILD-TUNING Approach to Efficient Hyperparameter Optimization of Child Networks for Speech Processing Tasks in the SUPERB Benchmark
190	Distilling Knowledge from Gaussian Process Teacher to Neural Network Student	➖
135	Segmental SpeechCLIP: Utilizing Pretrained Image-Text Models for Audio-Visual Learning	➖
421	Towards Hate Speech Detection in Low-Resource Languages: Comparing ASR to Acoustic Word Embeddings on Wolof and Swahili	➖
385	Mitigating Catastrophic Forgetting for Few-Shot Spoken Word Classification through Meta-Learning
664	Online Punctuation Restoration using ELECTRA Model for Streaming ASR Systems	➖
2066	Language Agnostic Data-Driven Inverse Text Normalization	➖
1079	How to Estimate Model Transferability of Pre-trained Speech Models?	➖
1655	Transcribing Speech as Spoken and Written Dual Text using an Autoregressive Model	➖
587	Phonetic and Prosody-aware Self-Supervised Learning Approach for Non-Native Fluency Scoring	➖
380	Disentangling the Contribution of Non-Native Speech in Automated Pronunciation Assessment	➖
337	A Joint Model for Pronunciation Assessment and Mispronunciation Detection and Diagnosis with Multi-task Learning	➖
1635	Assessing Intelligibility in Non-Native Speech: Comparing Measures Obtained at Different Levels	➖
585	End-to-End Word-Level Pronunciation Assessment with MASK Pre-training	➖
550	A Hierarchical Context-aware Modeling Approach for Multi-Aspect and Multi-Granular Pronunciation Assessment	➖
2541	Automatic Prediction of Language Learners' Listenability using Speech and Text Features Extracted from Listening Drills	➖
2371	Assessment of Non-Native Speech Intelligibility using Wav2vec2-based Mispronunciation Detection and Multi-Level Goodness of Pronunciation Transformer	➖
1899	Adapting an Unadaptable ASR System	➖
533	Addressing Cold Start Problem for End-to-End Automatic Speech Scoring	➖
816	Improving Grapheme-to-Phoneme Conversion by Learning Pronunciations from Speech Recordings	➖
2577	Orthography-based Pronunciation Scoring for Better CAPT Feedback	➖
1592	Zero-Shot Automatic Pronunciation Assessment	➖
364	Mispronunciation Detection and Diagnosis Model for Tonal Language, Applied to Vietnamese
793	An Efficient and Noise-Robust Audiovisual Encoder for Audiovisual Speech Recognition	➖
540	A Novel Self-training Approach for Low-Resource Speech Recognition	➖
1428	FunASR: A Fundamental End-to-End Speech Recognition Toolkit
487	Streaming Audio-Visual Speech Recognition with Alignment Regularization	➖
462	SparseVSR: Lightweight and Noise Robust Visual Speech Recognition	➖
2262	Multimodal Speech Recognition for Language-Guided Embodied Agents

Lexical and Language Modeling for ASR

🆔	Title	Repo	Paper
643	NoRefER: A Referenceless Quality Metric for Automatic Speech Recognition via Semi-Supervised Language Model Fine-Tuning with Contrastive Learning
2128	Scaling Laws for Discriminative Speech Recognition Rescoring Models	➖
2429	Exploring Energy-based Language Models with Different Architectures and Training Methods for Speech Recognition
1362	Memory Augmented Lookup Dictionary based Language Modeling for Automatic Speech Recognition	➖
1251	Memory Network-based End-To-End Neural ES-KMeans for Improved Word Segmentation	➖
1320	Retraining-free Customized ASR for Enharmonic Words based on a Named-Entity-Aware Model and Phoneme Similarity Estimation	➖

Language Identification and Diarization

🆔	Title	Repo	Paper
304	Lightweight and Efficient Spoken Language Identification of Long-form Audio	➖
1109	End-to-End Spoken Language Diarization with Wav2vec Embeddings
1986	Efficient Spoken Language Recognition via Multilabel Classification
1529	Description and Analysis of ABC Submission to NIST LRE 2022	➖
1790	Exploring the Impact of Pretrained Models and Web-Scraped Data for the 2022 NIST Language Recognition Evaluation	➖
1094	Advances in Language Recognition in Low Resource African Languages: The JHU-MIT Submission for NIST LRE22	➖

Speech Quality Assessment

🆔	Title	Repo	Paper
1436	DeePMOS: Deep Posterior Mean-Opinion-Score of Speech
1644	The Role of Formant and Excitation Source Features in Perceived Naturalness of Low Resource Tribal Language TTS: An Empirical Study	➖
811	A No-Reference Speech Quality Assessment Method based on Neural Network with Densely Connected Convolutional Architecture	➖
2507	Probing Speech Quality Information in ASR Systems	➖
589	Preference-based Training Framework for Automatic Speech Quality Assessment using Deep Neural Network	➖
389	Crowdsourced Data Validation for ASR Training	➖

Feature Modeling for ASR

🆔	Title	Repo	Paper
2296	Re-Investigating the Efficient Transfer Learning of Speech Foundation Model using Feature Fusion Methods	➖
1556	Robust Automatic Speech Recognition via WavAugment Guided Phoneme Adversarial Training	➖
509	InterFormer: Interactive Local and Global Features Fusion for Automatic Speech Recognition	➖
579	Transductive Feature Space Regularization for Few-Shot Bioacoustic Event Detection	➖
615	Incorporating L2 Phonemes using Articulatory Features for Robust Speech Recognition	➖
1510	On the (In)Efficiency of Acoustic Feature Extractors for Self-Supervised Speech Representation Learning	➖

Interfacing Speech Technology and Phonetics

🆔	Title	Repo	Paper
1846	Phonemic Competition in End-to-End ASR models	➖
443	Automatic Speaker Recognition with Variation Across Vocal Conditions: A Controlled Experiment with Implications for Forensics	➖
1398	Exploring Graph Theory Methods for the Analysis of Pronunciation Variation in Spontaneous Speech	➖
680	Automatic Speaker Recognition Performance with Matched and Mismatched Female Bilingual Speech Data	➖

Speech Synthesis: Multilinguality

🆔	Title	Repo	Paper
2303	FACTSpeech: Speaking a Foreign Language Pronunciation using Only Your Native Characters
934	Cross-Lingual Transfer Learning for Phrase Break Prediction with Multilingual Language Model	➖
363	DSE-TTS: Dual Speaker Embedding for Cross-Lingual Text-to-Speech
1467	Generating Multilingual Gender-Ambiguous Text-to-Speech Voices
2330	RADMMM: Multilingual Multiaccented Multispeaker Text-to-Speech	➖
861	Multilingual Context-based Pronunciation Learning for Text-to-Speech	➖

Speech Emotion Recognition

🆔	Title	Repo	Paper
2170	Personalized Adaptation with Pre-trained Speech Encoders for Continuous Emotion Recognition	➖
1113	The Importance of Calibration: Rethinking Confidence and Performance of Speech Multi-Label Emotion Classifiers	➖
1080	A Preliminary Study on Augmenting Speech Emotion Recognition using a Diffusion Model
454	Privacy Risks in Speech Emotion Recognition: A Systematic Study on Gender Inference Attack	➖
2111	Episodic Memory For Domain-Adaptable, Robust Speech Emotion Recognition	➖
80	Stable Speech Emotion Recognition with Head-k-Pooling Loss	➖
890	A Context-Constrained Sentence Modeling for Deception Detection in Real Interrogation	➖
819	MetricAug: A Distortion Metric-Lead Augmentation Strategy for Training Noise-Robust Speech Emotion Recognizer
240	The Co-use of Laughter and Head Gestures Across Speech Styles	➖
1351	EmotionNAS: Two-Stream Neural Architecture Search for Speech Emotion Recognition	➖
136	Pre-Finetuning for Few-Shot Emotional Speech Recognition
293	Integrating Emotion Recognition with Speech Recognition and Speaker Diarization for Conversations
1075	Utility-Preserving Privacy-Enabled Speech Embeddings for Emotion Detection	➖
1923	Node-weighted Graph Convolutional Network for Depression Detection in Transcribed Clinical Interviews
1914	Laughter in Task-based Settings: Whom We Talk to Affects How, When, and How Often We Laugh	➖
653	Exploring Downstream Transfer of Self-Supervised Features for Speech Emotion Recognition	➖
1758	Leveraging Semantic Information for Efficient Self-Supervised Emotion Recognition with Audio-Textual Distilled Models	➖
756	Two-Stage Finetuning of Wav2vec 2.0 for Speech Emotion Recognition with ASR and Gender Pretraining	➖
1311	Investigating Acoustic Cues for Multilingual Abuse Detection
1600	A Novel Frequency Warping Scale for Speech Emotion Recognition	➖
1170	Multi-Scale Temporal Transformer for Speech Emotion Recognition	➖
1169	Distant Speech Emotion Recognition in an Indoor Human-Robot Interaction Scenario	➖
2498	A Study on Prosodic Entrainment in Relation to Therapist Empathy in Counseling Conversation	➖
2375	Improving Joint Speech and Emotion Recognition using Global Style Tokens	➖
1163	Speech Emotion Recognition by Estimating Emotional Label Sequences with Phoneme Class Attribute	➖
274	Unsupervised Transfer Components Learning for Cross-Domain Speech Emotion Recognition	➖
1090	Dual Memory Fusion for Multimodal Speech Emotion Recognition	➖
311	Hybrid Dataset for Speech Emotion Recognition in Russian Language	➖
396	Speech Emotion Recognition using Decomposed Speech via Multi-Task Learning	➖

Spoken Dialog Systems and Conversational Analysis

🆔	Title	Repo	Paper
46	FC-MTLF: A Fine- and Coarse-grained Multi-task Learning Framework for Cross-Lingual Spoken Language Understanding	➖
93	C2A-SLU: Cross and Contrastive Attention for Improving ASR Robustness in Spoken Language Understanding	➖
2300	Tri-level Joint Natural Language Understanding for Multi-turn Conversational Datasets
2234	Semantic Enrichment Towards Efficient Speech Representations	➖
1299	Tensor Decomposition for Minimization of E2E SLU Model Toward On-Device Processing	➖
699	DiffSLU: Knowledge Distillation based Diffusion Model for Cross-Lingual Spoken Language Understanding	➖
1962	Integrating Pretrained ASR and LM to perform Sequence Generation for Spoken Language Understanding	➖
644	Contrastive Learning based ASR Robust Knowledge Selection for Spoken Dialogue System	➖
1859	Unsupervised Dialogue Topic Segmentation in Hyperdimensional Space
198	An Investigation of the Combination of Rehearsal and Knowledge Distillation in Continual Learning for Spoken Language Understanding
1740	Enhancing New Intent Discovery via Robust Neighbor-based Contrastive Learning	➖
211	Personalized Predictive ASR for Latency Reduction in Voice Assistants	➖
1419	Compositional Generalization in Spoken Language Understanding	➖
2314	Sampling Bias in NLU Models: Impact and Mitigation	➖
1038	5IDER: Unified Query Rewriting for Steering, Intent Carryover, Disfluencies, Entity Carryover and Repair	➖
1236	Emotion Awareness in Multi-utterance Turn for Improving Emotion Prediction in Multi-Speaker Conversation	➖
1505	WhiSLU: End-to-End Spoken Language Understanding with Whisper	➖
1947	Relationship between Auditory and Semantic Entrainment using Deep Neural Networks (DNN)	➖
1929	Unsupervised Auditory and Semantic Entrainment Models with Deep Neural Networks	➖
952	Prosodic Features Improve Sentence Segmentation and Parsing in English	➖
320	Estimation of Listening Response Timing by Generative Model and Parameter Control of Response Substantialness using Dynamic-Prompt-Tune	➖
1885	Parameter Selection for Analyzing Conversations with Autism Spectrum Disorder	➖
2341	Efficient Multimodal Neural Networks for Trigger-Less Voice Assistants	➖
2332	Rapid Lexical Alignment to a Conversational Agent	➖
578	Multimodal Turn-Taking Model using Visual cues for End-of-Utterance Prediction in Spoken Dialogue Systems	➖
1464	Audio-Visual Praise Estimation for Conversational Video based on Synchronization-Guided Multimodal Transformer	➖
1618	Improving the Response Timing Estimation for Spoken Dialogue Systems by Reducing the Effect of Speech Recognition Delay	➖
555	Focus-Attention-Enhanced Cross-Modal Transformer with Metric Learning for Multimodal Speech Emotion Recognition	➖
1717	A Multiple-Teacher Pruning based Self-Distillation (MT-PSD) Approach to Model Compression for Audio-Visual Wake Word Spotting	➖
789	Abusive Speech Detection in Indic Languages using Acoustic Features	➖
1791	Listening to Silences In Contact Center Conversations using Textual cues	➖
2475	I Learned Error, I Can Fix It!: A Detector-Corrector Structure for ASR Error Calibration
1074	Verbal and Nonverbal Feedback Signals in Response to Increasing Levels of Miscommunication	➖
76	Speech-based Classification of Defensive Communication: A Novel Dataset and Results	➖
1951	Quantifying the Perceptual Value of Lexical and Non-Lexical Channels in Speech
1267	Relationships between Gender, Personality Traits and Features of Multi-Modal Data to Responses to Spoken Dialog Systems Breakdown	➖
1650	Speaker-aware Cross-Modal Fusion Architecture for Conversational Emotion Recognition	➖

Speech Coding and Enhancement

🆔	Title	Repo	Paper
936	Biophysically-Inspired Single-Channel Speech Enhancement in the Time Domain	➖
1902	On-Device Speaker Anonymization of Acoustic Embeddings for ASR based on Flexible Location Gradient Reversal Layer	➖
1901	How to Construct Perfect and Worse-than-Coin-Flip Spoofing Countermeasures: A Word of Warning on Shortcut Learning	➖
1287	CleanUNet 2: A Hybrid Speech Denoising Model on Waveform and Spectrogram
521	A Two-Stage Progressive Neural Network for Acoustic echo Cancellation	➖
537	An Intra-BRNN and GB-RVQ based End-to-End Neural Audio Codec	➖
1066	Real-Time Personalised Speech Enhancement Transformers with Dynamic Cross-Attended Speaker Representations
280	CFTNet: Complex-Valued Frequency Transformation Network for Speech Enhancement	➖
623	Feature Normalization for Fine-Tuning Self-Supervised Models in Speech Enhancement	➖
1490	Multi-Mode Neural Speech Coding based on Deep Generative Networks	➖
751	Streaming Dual-Path Transformer for Speech Enhancement	➖
1848	Sequence-to-Sequence Multi-Modal Speech In-Painting	➖
984	Hybrid AHS: A Hybrid of Kalman Filter and Deep Learning for Acoustic Howling Suppression	➖
551	Differentially Private Adapters for Parameter Efficient Acoustic Modeling
780	Incorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement through Knowledge Distillation
2568	Consonant-Emphasis Method Incorporating Robust Consonant-Section Detection to Improve Intelligibility of Bone-Conducted Speech	➖
1578	Downstream Task-Agnostic Speech Enhancement with Self-Supervised Representation Loss	➖
2305	Perceptual Improvement of Deep Neural Network (DNN) Speech Coder using Parametric and Nonparametric Density Models	➖
2437	DeFT-AN RT: Real-Time Multichannel Speech Enhancement using Dense Frequency-Time Attentive Network and Non-overlapping Synthesis Window	➖
1376	PCNN: A Lightweight Parallel Conformer Neural Network for Efficient Monaural Speech Enhancement	➖
1364	Exploring the Interactions between Target Positive and Negative Information for Acoustic Echo Cancellation	➖
365	Iterative Autoregression: A Novel Trick to Improve your Low-Latency Speech Enhancement Model	➖
1084	A Multi-Dimensional Deep Structured State Space Approach to Speech Enhancement using Small-Footprint Models
705	Domain Adaptation for Speech Enhancement in a Large Domain Gap	➖
456	SCP-GAN: Self-Correcting Discriminator Optimization for Training Consistency Preserving Metric GAN on Speech Enhancement Tasks	➖
339	A Mask Free Neural Network for Monaural Speech Enhancement
1548	A Training and Inference Strategy using Noisy and Enhanced Speech as Target for Speech Enhancement without Clean Speech
2418	A Simple RNN Model for Lightweight, Low-Compute and Low-Latency Multichannel Speech Enhancement in the Time Domain	➖
1433	High Fidelity Speech Enhancement with Band-Split RNN	➖
218	Focus on the Sound around You: Monaural Target Speaker Extraction via Distance and Speaker Information
882	DFSNet: A Steerable Neural Beamformer Invariant to Microphone Array Configuration for Real-Time, Low-Latency Speech Enhancement	➖
1323	Speaker-Aware Anti-Spoofing	➖
1116	Impact of Residual Noise and Artifacts in Speech Enhancement Errors on Intelligibility of Human and Machine	➖
799	EffCRN: An Efficient Convolutional Recurrent Network for High-Performance Speech Enhancement	➖
1795	HAD-ANC: A Hybrid System Comprising an Adaptive Filter and Deep Neural Networks for Active Noise Control
886	MSAF: A Multiple Self-Attention Field Method for Speech Enhancement
2302	Ultra Dual-Path Compression for Joint echo Cancellation and Noise Suppression	➖
971	ABC-KD: Attention-based-Compression Knowledge Distillation for Deep Learning-based Noise Suppression	➖
1532	PLCMOS – a Data-Driven Non-Intrusive Metric for the Evaluation of Packet Loss Concealment Algorithms
1910	Multi-Dataset Co-training with Sharpness-aware Optimization for Audio Anti-Spoofing	➖
1445	Reducing the Prior Mismatch of Stochastic Differential Equations for Diffusion-based Speech Enhancement
901	Complex-valued Neural Networks for Voice Anti-Spoofing	➖
1028	DeepVQE: Real Time Deep Voice Quality Enhancement for Joint Acoustic echo Cancellation, Noise Suppression and Dereverberation
1547	Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancement
1642	HD-DEMUCS: General Speech Restoration with Heterogeneous Decoders	➖
1441	MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectra
565	TRIDENTSE: Guiding Speech Enhancement with 32 Global Tokens	➖
1254	Detection of Cross-Dataset Fake Audio based on Prosodic and Pronunciation Features	➖
1890	Self-Supervised Learning with Diffusion based Multichannel Speech Enhancement for Speaker Verification under Noisy Conditions	➖
1341	Two-Stage Voice Anonymization for Enhanced Privacy	➖
2055	Personalized Dereverberation of Speech
580	Weighted Von Mises Distribution-based Loss Function for Real-Time STFT Phase Reconstruction using DNN	➖
272	Deep Multi-Frame Filtering for Hearing Aids
1232	Aligning Speech Enhancement for Improving Downstream Classification Performance	➖
420	DNN-based Parameter Estimation for MVDR Beamforming and Post-Filtering	➖
675	FRA-RIR: Fast Random Approximation of the Image-Source
686	Rethinking Complex-Valued Deep Neural Networks for Monaural Speech Enhancement	➖
186	Harmonic Enhancement using Learnable Comb Filter for Light-Weight Full-band Speech Enhancement Model	➖

Paralinguistics

🆔	Title	Repo	Paper
1023	Detection of Emotional Hotspots in Meetings using a Cross-Corpus Approach	➖
1412	Detection of Laughter and Screaming using the Attention and CTC Models	➖
1852	Capturing Formality in Speech Across Domains and Languages	➖
460	Towards Robust Family-Infant Audio Analysis based on Unsupervised Pretraining of Wav2vec 2.0 on Large-Scale Unlabeled Family Audio
778	Cues to Next-Speaker Projection in Conversational Swedish: Evidence from Reaction Times	➖
1200	Multiple Instance Learning for Inference of Child Attachment from Paralinguistic Aspects of Speech	➖
2070	Speaker Embeddings as Individuality Proxy for Voice Stress Detection	➖
2213	From Interval to Ordinal: A HMM based Approach for Emotion Label Conversion	➖
661	Turbo your Multi-Modal Classification with Contrastive Learning	➖
497	Towards Paralinguistic-Only Speech Representations for End-to-End Speech Emotion Recognition	➖
1360	SOT: Self-Supervised Learning-Assisted Optimal Transport for Unsupervised Adaptive Speech Emotion Recognition	➖
2464	On the Efficacy and Noise-Robustness of Jointly Learned Speech Emotion and Automatic Speech Recognition	➖
830	Speaking State Decoder with Transition Detection for Next Speaker Prediction	➖
1507	What are Differences? Comparing DNN and Human by their Performance and Characteristics in Speaker Age Estimation	➖
846	Effects of Perceived Gender on the Perceived Social Function of Laughter	➖
1999	Implicit Phonetic Information Modeling for Speech Emotion Recognition	➖
1034	Computation and Memory Efficient Noise Adaptation of Wav2Vec2.0 for Noisy Speech Emotion Recognition with Skip Connection Adapters	➖
300	Multi-Level Knowledge Distillation for Speech Emotion Recognition in Noisy Conditions	➖
1108	Preference Learning Labels by Anchoring on Consecutive Annotations	➖
2561	Transforming the Embeddings: A Lightweight Technique for Speech Emotion Recognition Tasks	➖
543	Learning Local to Global Feature Aggregation for Speech Emotion Recognition	➖
842	Supervised Contrastive Learning with Nearest Neighbor Search for Speech Emotion Recognition	➖

Speech Enhancement and Denoising

🆔	Title	Repo	Paper
1088	Real-Time Joint Personalized Speech Enhancement and Acoustic echo Cancellation	➖
514	TaylorBeamixer: Learning Taylor-Inspired All-Neural Multi-Channel Speech Enhancement from Beam-Space Dictionary Perspective
865	MFT-CRN:Multi-Scale Fourier Transform for Monaural Speech Enhancement	➖
1265	Variance-Preserving-based Interpolation Diffusion Models for Speech Enhancement	➖
318	Multi-Input Multi-Output Complex Spectral Mapping for Speaker Separation	➖
992	Short-Term Extrapolation of Speech Signals using Recursive Neural Networks in the STFT Domain	➖

Speech Synthesis: Evaluation

🆔	Title	Repo	Paper
1843	Listener Sensitivity to Deviating Obstruents in WaveNet	➖
981	How Generative Spoken Language Modeling Encodes Noisy Speech: Investigation from Phonetics to Syntactics	➖
2014	MOS vs. AB: Evaluating Text-to-Speech Systems Reliably using Clustered Standard Errors	➖
851	RAMP: Retrieval-Augmented MOS Prediction via Confidence-based Dynamic Weighting	➖
2013	Can Better Perception Become a Disadvantage? Synthetic Speech Perception in Congenitally Blind Users	➖
1076	Investigating Range-Equalizing Bias in Mean Opinion Score Ratings of Synthesized Speech	➖

End-to-End Spoken Dialog Systems

🆔	Title	Repo	Paper
1799	Can ChatGPT Detect Intent? Evaluating Large Language Models for Spoken Language Understanding
1760	Improving End-to-End SLU performance with Prosodic Attention and Distillation
2575	Modality Confidence Aware Training for Robust End-to-End Spoken Language Understanding	➖
758	Cross-Modal Semantic Alignment before Fusion for Two-Pass End-to-End Spoken Language	➖
2018	ConvKT: Conversation-Level Knowledge Transfer for Context Aware End-to-End Spoken Language Understanding	➖
41	GhostT5: Generate More Features with Cheap Operations to Improve Textless Spoken Question Answering	➖

Biosignal-enabled Spoken Communication

🆔	Title	Repo	Paper
278	Obstructive Sleep Apnea Detection using Pretrained Speech Representations	➖
620	EEG-based Auditory Attention Detection with Spatiotemporal Graph and Graph Convolutional Network	➖
1966	Silent Speech Recognition with Articulator Positions Estimated from Tongue Ultrasound and Lip Video	➖
1377	Auditory Attention Detection in Real-Life Scenarios using Common Spatial Patterns from EEG	➖
1381	Diff-E: Diffusion-based Learning for Decoding Imagined Speech EEG
40	Towards Ultrasound Tongue Image Prediction from EEG During Speech Production
1607	Adaptation of Tongue Ultrasound-based Silent Speech Interfaces using Spatial Transformer Networks	➖
174	STE-GAN: Speech-to-Electromyography Signal Conversion using Generative Adversarial Networks
1881	Spanish Phone Confusion Analysis for EMG-based Silent Speech Interfaces	➖
805	Hybrid Silent Speech Interface through Fusion of Electroencephalography and Electromyography

Neural-based Speech and Acoustic Analysis

🆔	Title	Repo	Paper
1968	Can Self-Supervised Neural Representations Pre-trained on Human Speech Distinguish Animal Callers?
2342	Discovering COVID-19 Coughing and Breathing Patterns from Unlabeled Data using Contrastive Learning with Varying Pre-Training Domains	➖
330	Background-aware Modeling for Weakly Supervised Sound Event Detection	➖
1065	How to (Virtually) Train Your Speaker Localizer
2271	MMER: Multimodal Multi-task Learning for Speech Emotion Recognition
909	A Multi-task Learning Framework for Sound Event Detection using High-Level Acoustic Characteristics of Sounds	➖

DiGo - Dialog for Good: Speech and Language Technology for Social Good

🆔	Title	Repo	Paper
2194	A Multimodal Investigation of Speech, Text, Cognitive and Facial Video Features for Characterizing Depression with and without Medication	➖
307	Understanding Disrupted Sentences using Underspecified Abstract Meaning Representation
2109	Developing Speech Processing Pipelines for Police Accountability	➖
2086	Prosody-Controllable Gender-Ambiguous Speech Synthesis: A Tool for Investigating Implicit Bias in Speech Perception
848	Affective Attributes of French Caregivers' Professional Speech	➖

Spoken Language Processing: Translation, Information Retrieval, Summarization, Resources, and Evaluation

🆔	Title	Repo	Paper
180	Pragmatic Pertinence: A Learnable Confidence Metric to Assess the Subjective Quality of LM-Generated Text	➖
2078	ASR and Emotional Speech: A Word-Level Investigation of the Mutual Impact of Speech and Emotion Recognition	➖
916	BASS: Block-wise Adaptation for Speech Summarization
1258	Speaker Tracking using Graph Attention Networks with Varying Duration Utterances in Multi-Channel Naturalistic Data: Fearless Steps Apollo 11 Audio Corpus	➖
36	Combining Language Corpora in a Japanese Electromagnetic Articulography Database for Acoustic-to-Articulatory Inversion	➖
523	A Dual Attention-based Modality-Collaborative Fusion Network for Emotion Recognition
2174	Large Dataset Generation of Synchronized Music Audio and Lyrics at Scale using Teacher-Student Paradigm	➖
483	Enc-Dec RNN Acoustic Word Embeddings Learned via Pairwise Prediction
864	Query based Acoustic Summarization for Podcasts	➖
1242	Spot Keywords from Very Noisy and Mixed Speech	➖
891	Knowledge Distillation on Joint Task End-to-End Speech Translation	➖
343	Investigating Pre-trained Audio Encoders in the Low-Resource Condition
1718	Improving Textless Spoken Language Understanding with Discrete Units as Intermediate Target	➖
823	MAVD: The First Open Large-Scale Mandarin Audio-Visual Dataset with Depth Information
1674	CN-Celeb-AV: A Multi-Genre Audio-Visual Dataset for Person Recognition
1762	Improving Zero-Shot Cross-Domain Slot Filling via Transformer-based Slot Semantics Fusion	➖
619	Rethinking Transfer and Auxiliary Learning for Improving Audio Captioning Transformer	➖
1468	Boosting Punctuation Restoration with Data Generation and Reinforcement Learning	➖
695	J-ToneNet: A Transformer-based Encoding Network for Improving Tone Classification in Continuous Speech via F0 Sequences	➖
1152	Towards Cross-Language Prosody Transfer for Dialog
2506	Strategies for Improving Low Resource Speech to Text Translation Relying on Pre-trained ASR Models	➖
1980	ITALIC: An Italian Intent Classification Dataset
1778	Perceptual and Task-Oriented Assessment of a Semantic Metric for ASR Evaluation	➖
1466	How ChatGPT is Robust for Spoken Language Understanding?	➖
1233	GigaST: A 10,000-hour Pseudo Speech Translation Corpus
1570	Boosting Chinese ASR Error Correction with Dynamic Error Scaling Mechanism	➖
2473	Crowdsource-based Validation of the Audio Cocktail as a Sound Browsing Tool	➖
1675	PunCantonese: A Benchmark Corpus for Low-Resource Cantonese Punctuation Restoration from Speech Transcripts
1358	Speech-to-Face Conversion using Denoising Diffusion Probabilistic Models	➖
2255	Inter-Connection: Effective Connection between Pre-trained Encoder and Decoder for Speech Translation	➖
1068	How Does Pretraining Improve Discourse-aware Translation?	➖
1135	PATCorrect: Non-Autoregressive Phoneme-Augmented Transformer for ASR Error Correction	➖
161	Model-assisted Lexical Tone Evaluation of Three-Year-Old Chinese-Speaking Children by also Considering Segment Production	➖
1392	Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken Language Understanding
1582	Joint Time and Frequency Transformer for Chinese Opera Classification	➖
116	AdaMS: Deep Metric Learning with Adaptive Margin and Adaptive Scale for Acoustic Word Discrimination	➖
2252	Investigating Reproducibility at Interspeech Conferences: A Longitudinal and Comparative Perspective	➖
2250	Combining Heterogeneous Structures for Event Causality Identification	➖
1208	An Efficient Approach for the Automated Segmentation and Transcription of the People's Speech Corpus	➖
1425	Diverse Feature Mapping and Fusion via Multitask Learning for Multilingual Speech Emotion Recognition	➖
903	Take the Hint: Improving Arabic Diacritization with Partially-Diacritized Text
466	Low-Resource Cross-Lingual Adaptive Training for Nigerian Pidgin
1878	Efficient Adaptation of Spoken Language Understanding based on End-to-End Automatic Speech Recognition	➖
597	PhonMatchNet: Phoneme-Guided Zero-Shot Keyword Spotting for User-Defined Keywords
69	Mix before Align: Towards Zero-Shot Cross-Lingual Sentiment Analysis via Soft-Mix and Multi-View Learning	➖
170	AlignAtt: using Attention-based Audio-Translation Alignments as a Guide for Simultaneous Speech Translation	➖
2225	Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff	➖
1979	Zambezi Voice: A Multilingual Speech Corpus for Zambian Languages

Speech, Voice, and Hearing Disorders

🆔	Title	Repo	Paper
2421	Debiased Automatic Speech Recognition for Dysarthric Speech via Sample Reweighting with Sample Affinity Test	➖
2198	Multimodal Locally Enhanced Transformer for Continuous Sign Language Recognition	➖
1759	Towards Supporting an Early Diagnosis of Multiple Sclerosis using Vocal Features	➖
1891	Whisper Features for Dysarthric Severity-Level Classification	➖
2191	A New Benchmark of Aphasia Speech Recognition and Detection based on E-Branchformer and Multi-task Learning
222	Dysarthric Speech Recognition, Detection and Classification using Raw Phase and Magnitude Spectra	➖
2026	A Stutter Seldom Comes Alone - Cross-Corpus Stuttering Detection as a Multi-label Problem	➖
1542	Transfer Learning to Aid Dysarthria Severity Classification for Patients with Amyotrophic Lateral Sclerosis	➖
2203	DuTa-VC: A Duration-aware Typical-to-Atypical Voice Conversion Approach with Diffusion Probabilistic Model
201	CNVVE: Dataset and Benchmark for Classifying Non-verbal Voice
1541	Arabic Dysarthric Speech Recognition using Adversarial and Signal-based Augmentation
1887	Weakly-Supervised Forced Alignment of Disfluent Speech using Phoneme-level Modeling
1998	Glottal Source Analysis of Voice Deficits in Basal Ganglia Dysfunction: Evidence from de novo Parkinson's Disease and Huntington's Disease	➖
2478	An Analysis of Glottal Features of Chronic Kidney Disease Speech and its Application to CKD Detection	➖
983	Weakly Supervised Glottis Segmentation in High-Speed Video Endoscopy using Bounding Box Labels	➖
1669	Investigating the Dynamics of Hand and Lips in French Cued Speech using Attention Mechanisms and CTC-based Decoding	➖
670	Hearing Loss Affects Emotion Perception in Older Adults: Evidence from a Prosody-Semantics Stroop Task	➖
554	Cochlear-Implant Listeners Listening to Cochlear-Implant Simulated Speech	➖
2168	Validation of a Task-Independent Cepstral Peak Prominence Measure with Voice Activity Detection	➖
1679	Score-balanced Loss for Multi-aspect Pronunciation Assessment
2108	Federated Learning for Secure Development of AI Models for Parkinson's Disease Detection using Speech from Different Languages	➖
652	F0inTFS: A Lightweight Periodicity Enhancement Strategy for Cochlear Implants	➖
1678	Differentiating Acoustic and Physiological Features in Speech for Hypoxia Detection	➖
786	Mandarin Electrolaryngeal Speech Voice Conversion using Cross-Domain Features	➖
866	Audio-Visual Mandarin Electrolaryngeal Speech Voice Conversion	➖
1744	Which Aspects of Motor Speech Disorder are Captured by Mel Frequency Cepstral Coefficients? Evidence from the Change in STN-DBS Conditions in Parkinson's Disease	➖
1096	Detecting Manifest Huntington's Disease using Vocal Data	➖
1623	Exploring Multi-Task Learning and Data Augmentation in Dementia Detection with Self-Supervised Pre-trained Models	➖

Spoken Term Detection and Voice Search

🆔	Title	Repo	Paper
478	Matching Latent Encoding for Audio-Text based Keyword Spotting	➖
1215	Self-Paced Pattern Augmentation for Spoken Term Detection in Zero-Resource	➖
2362	On-Device Constrained Self-Supervised Speech Representation Learning for Keyword Spotting via Knowledge Distillation	➖
90	Online Continual Learning in Keyword Spotting for Low-Resource Devices via Pooling High-Order Temporal Statistics	➖
689	Improving Small Footprint Few-Shot Keyword Spotting with Supervision on Auxiliary Data	➖
2222	Robust Keyword Spotting for Noisy Environments by Leveraging Speech Enhancement and Speech Presence Probability	➖

Models for Streaming ASR

🆔	Title	Repo	Paper
831	Enhancing the Unified Streaming and Non-Streaming Model with Contrastive Learning	➖
1497	ZeroPrompt: Streaming Acoustic Encoders are Zero-Shot Masked LMs	➖
361	Improved Training for End-to-End Streaming Automatic Speech Recognition Model with Punctuation	➖
1129	DCTX-Conformer: Dynamic Context Carry-over for Low Latency Unified Streaming and Non-Streaming Conformer	➖
1121	Knowledge Distillation from Non-Streaming to Streaming ASR Encoder using Auxiliary Non-Streaming Layer	➖
884	Adaptive Contextual Biasing for Transducer based Streaming Speech Recognition	➖

Source Separation

🆔	Title	Repo	Paper
1753	Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Model
1389	Remixing-based Unsupervised Source Separation from Scratch	➖
577	CAPTDURE: Captioned Sound Dataset of Single Sources	➖
488	Recursive Sound Source Separation with Deep Learning-based Beamforming for Unknown Number of Sources	➖
2537	Multi-Channel Speech Separation with Cross-Attention and Beamforming	➖
185	Background-Sound Controllable Voice Source Separation	➖

Speech Perception

🆔	Title	Repo	Paper
1922	A Neural Architecture for Selective Attention to Speech Features	➖
1122	Quantifying Informational Masking due to Masker Intelligibility in Same-Talker Speech-in-Speech Perception	➖
1476	On the Benefits of Self-Supervised Learned Speech Representations for Predicting Human Phonetic Misperceptions	➖
2154	Predicting Perceptual Centers Located at Vowel Onset in German Speech using Long Short-Term Memory Networks	➖
63	Exploring the Mutual Intelligibility Breakdown Caused by Sculpting Speech from a Competing Speech Signal	➖
2103	Perception of Incomplete Voicing Neutralization of Obstruents in Tohoku Japanese	➖

Phonetics and Phonology: Languages and Varieties

🆔	Title	Repo	Paper
1879	The Emergence of Obstruent-Intrinsic f0 and VOT as Cues to the Fortis/Lenis Contrast in West Central Bavarian	➖
431	〈'〉 in Tsimane': A Preliminary Investigation
2200	Segmental Features of Brazilian (Santa Catarina) Hunsrik	➖
2337	Opening or Closing? An Electroglottographic Analysis of Voiceless Coda Consonants in Australian English	➖
295	Increasing Aspiration of Word-Medial Fortis Plosives in Swiss Standard German	➖
1456	Lexical Stress and Velar Palatalization in Italian: A Spatio-Temporal Interaction	➖

Speaker and Language Identification

🆔	Title	Repo	Paper
1989	Vietnam-Celeb: A Large-Scale Dataset for Vietnamese Speaker Recognition
2254	What Can an Accent Identifier Learn? Probing Phonetic and Prosodic Information in a Wav2vec2-based Accent Identification Model
241	The 2022 NIST Language Recognition Evaluation	➖
155	Description and Analysis of the KPT system for NIST Language Recognition Evaluation 2022	➖
1725	ACA-Net: Towards Lightweight Speaker Verification using Asymmetric Cross Attention
402	Branch-ECAPA-TDNN: A Parallel Branch Architecture to Capture Local and Global Features for Speaker Verification	➖
2052	Speaker Verification Across Ages: Investigating Deep Speaker Embedding Sensitivity to Age Mismatch in Enrollment and Test Speech	➖
2569	Wavelet Scattering Transform for Improving Generalization in Low-Resourced Spoken Language Identification	➖
1407	A Parameter-Efficient Learning Approach to Arabic Dialect Identification with Pre-trained General Purpose Speech Model
2272	HABLA: A Dataset of Latin American Spanish Accents for Voice Anti-Spoofing
1702	Self-Supervised Learning Representation based Accent Recognition with Persistent Accent Memory	➖
800	Extremely Low Bit Quantization for Mobile Speaker Verification Systems Under 1MB Memory	➖
1974	Unsupervised Out-of-Distribution Dialect Detection with Mahalanobis Distance	➖
105	Pyannote.Audio 2.1 Speaker Diarization Pipeline: Principle, Benchmark and Recipe
1524	Model Compression for DNN-based Speaker Verification using Weight Quantization	➖
1354	Multi-Resolution Approach to Identification of Spoken Languages and to Improve Overall Language Diarization System using Whisper Model	➖
125	Improving Generalization Ability of Countermeasures for New Mismatch Scenario by Combining Multiple Advanced Regularization Terms	➖
849	Dynamic Fully-Connected Layer for Large-Scale Speaker Verification	➖
844	Reversible Neural Networks for Memory-Efficient Speaker Verification	➖
777	ECAPA++: Fine-grained Deep Embedding Learning for TDNN based Speaker Verification	➖
1206	TO-Rawnet: Improving RawNet with TCN and Orthogonal Regularization for Fake Audio Detection	➖
100	Fooling Speaker Identification Systems with Adversarial Background Music	➖
1314	Mutual Information-based Embedding Decoupling for Generalizable Speaker Verification	➖
574	Target Active Speaker Detection with Audio-Visual Cues
2401	Improving End-to-End Neural Diarization using Conversational Summary Representations	➖
2039	Phase Perturbation Improves Channel Robustness for Speech Spoofing Countermeasures
210	Improving Training Datasets for Resource-constrained Speaker Recognition Neural Networks	➖
1498	Instance-based Temporal Normalization for Speaker Verification	➖
881	On the Robustness of Wav2Vec 2.0 based Speaker Recognition Systems	➖
697	P-Vectors: A Parallel-coupled TDNN/Transformer Network for Speaker Verification
1249	Group GMM-ResNet for Detection of Synthetic Speech Attacks	➖
452	Robust Training for Speaker Verification against Noisy Labels
1404	Self-Distillation into Self-Attention Heads for Improving Transformer-based End-to-End Neural Speaker Diarization	➖
1217	Build a SRE Challenge System: Lessons from VoxSRC 2022 and CNSRC 2022
1648	Describing the Phonetics in the Underlying Speech Attributes for Deep and Interpretable Speaker Recognition
1214	Range-based Equal Error Rate for Spoof Localization	➖
1888	Exploring the English Accent-Independent Features for Speech Emotion Recognition using Filter and Wrapper-based Methods for Feature Selection	➖
205	Powerset Multi-Class Cross Entropy Loss for Neural Speaker Diarization
394	A Method of Audio-Visual Person Verification by Mining Connections between Time Series	➖
605	One-Step Knowledge Distillation and Fine-Tuning in using Large Pre-trained Self-Supervised Learning Models for Speaker Verification
409	Defense Against Adversarial Attacks on Audio DeepFake Detection
1820	A Conformer-based Classifier for Variable-Length Utterance Processing in Anti-Spoofing	➖
1557	Conformer-based Language Embedding with Self-Knowledge Distillation for Spoken Language Identification	➖
2419	CommonAccent: Exploring Large Acoustic Pre-trained Models for Accent Classification based on Common Voice	➖
266	From Adaptive Score Normalization to Adaptive Data Normalization for Speaker Verification Systems	➖
1513	CAM++: A Fast and Efficient Network for Speaker Verification using Context-aware Masking
1928	North Sámi Dialect Identification with Self-Supervised Speech Models
2289	Encoder-Decoder Multimodal Speaker Change Detection	➖
1603	Disentangled Representation Learning for Multilingual Speaker Recognition
2310	A Compact End-to-End Model with Local and Global Context for Spoken Language Identification
1005	On the Robustness of Arabic Speech Dialect Identification	➖
927	Adaptive Neural Network Quantization for Lightweight Speaker Verification	➖
1205	Adversarial Diffusion Probability Model For Cross-Domain Speaker Verification Integrating Contrastive Loss	➖
1554	Chinese Dialect Recognition based on Transfer Learning	➖
270	Spoofing Attacker also Benefits from Self-Supervised Pretrained Model	➖
854	Label aware Speech Representation Learning for Language Identification	➖
1761	Exploring the Impact of Back-end Network on Wav2vec 2.0 for Dialect Identification	➖
453	Improving Speaker Verification with Self-pretrained Transformer Models
372	Handling the Alignment for Wake Word Detection: A Comparison Between Alignment-based, Alignment-Free and Hybrid Approaches	➖

Speech Synthesis and Voice Conversion

🆔	Title	Repo	Paper
2336	Mitigating the Exposure Bias in Sentence-Level Grapheme-to-Phoneme (G2P) Transduction	➖
160	Streaming Parrotron for On-Device Speech-to-Speech Conversion	➖
2407	Exploiting Emotion Information in Speaker Embeddings for Expressive Text-to-Speech
2518	E2E-S2S-VC: End-to-End Sequence-to-Sequence Voice Conversion
2403	DC CoMix TTS: An End-to-End Expressive TTS with Discrete Code Collaborated with Mixer
419	Voice Conversion with Just Nearest Neighbors
1193	CFVC: Conditional Filtering for Controllable Voice Conversion
1157	DualVC: Dual-mode Voice Conversion using Intra-Model Knowledge Distillation and Hybrid Predictive Coding
39	Attention-based Interactive Disentangling Network for Instance-Level Emotional Voice Conversion
836	ALO-VC: Any-to-Any Low-Latency One-Shot Voice Conversion
1978	Evaluating and Reducing the Distance between Synthetic and Real Speech Distributions	➖
2202	Decoupling Segmental and Prosodic cues of Non-Native Speech through Vector Quantization
2383	VC-T: Streaming Voice Conversion based on Neural Transducer
191	Emo-StarGAN: A Semi-Supervised Any-to-Many Non-Parallel Emotion Preserving Voice Conversion
1788	ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and Speed
1356	Reverberation-Controllable Voice Conversion using Reverberation Time Estimator	➖
2558	Cross-Utterance Conditioned Coherent Speech Editing

Speech and Language in Health: from Remote Monitoring to Medical Conversations

🆔	Title	Repo	Paper
2287	An Automatic Multimodal Approach to Analyze Linguistic and Acoustic Cues on Parkinson's Disease Patients	➖
1332	Personalization for Robust Voice Pathology Detection in Sound Waves
2249	Integrated and Enhanced Pipeline System to Support Spoken Language Analytics for Screening Neurocognitive Disorders	➖
1990	Capturing Mismatch between Textual and Acoustic Emotion Expressions for Mood Identification in Bipolar Disorder	➖
296	FTA-Net: A Frequency and Time Attention Network for Speech Depression Detection	➖
1709	Bayesian Networks for the Robust and Unbiased Prediction of Depression and its Symptoms Utilizing Speech and Multimodal Data	➖
1263	Hyper-Parameter Adaptation of Conformer ASR Systems for Elderly and Dysarthric Speech Recognition	➖
1721	Classifying Depression Symptom Severity: Assessment of Speech Representations in Personalized and Generalized Machine Learning Models	➖
1946	Active Learning for Abnormal Lung Sound Data Curation and Detection in Asthma	➖
2079	Automatic Assessment of Alzheimer's across Three Languages using Speech and Language Features	➖
301	On-the-Fly Feature based Rapid Speaker Adaptation for Dysarthric and Elderly Speech Recognition
1722	Relationship between LTAS-based Spectral Moments and Acoustic Parameters of Hypokinetic Dysarthria in Parkinson's Disease	➖
963	Respiratory Distress Estimation in Human-Robot Interaction Scenario	➖
1771	Prediction of the Gender-based Violence Victim Condition using Speech: What do Machine Learning Models rely on?	➖
1916	Whisper Encoder features for Infant Cry Classification	➖
1997	Classifying Dementia in the Presence of Depression: A Cross-Corpus Study	➖
297	Exploiting Cross-Domain and Cross-Lingual Ultrasound Tongue Imaging Features for Elderly and Dysarthric Speech Recognition	➖
464	Multi-Class Detection of Pathological Speech with Latent Features: How does It Perform on Unseen Data?	➖
2002	Responsiveness, Sensitivity and Clinical Utility of Timing-Related Speech Biomarkers for Remote Monitoring of ALS Disease Progression	➖
322	Use of Speech Impairment Severity for Dysarthric Speech Recognition	➖
721	MMLung: Moving Closer to Practical Lung Health Estimation using Smartphones
913	Investigating the Utility of Synthetic Data for Doctor-Patient Conversation Summarization	➖
2101	Non-Uniform Speaker Disentanglement for Depression Detection from Raw Speech Signals
753	PoCaPNet: A Novel Approach for Surgical Phase Recognition using Speech and X-Ray Images
2100	Combining Multiple Multimodal Speech Features into an Interpretable Index Score for Capturing Disease Progression in Amyotrophic Lateral Sclerosis	➖
1438	The MASCFLICHT Corpus: Face Mask Type and Coverage Area Recognition from Speech
1435	Towards Reference Speech Characterization for Health Applications
2146	Automatic Classification of Hypokinetic and Hyperkinetic Dysarthria based on GMM-Supervectors	➖
947	Towards Robust Paralinguistic Assessment for Real-World Mobile Health (mHealth) Monitoring: an Initial Study of Reverberation Effects on Speech	➖

Novel Transformer Models for ASR

🆔	Title	Repo	Paper
2228	Conmer: Streaming Conformer without Self-Attention for Interactive Voice Assistants	➖
1255	Intra-Ensemble: A New Method for Combining Intermediate Outputs in Transformer-based Automatic Speech Recognition	➖
1194	A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Tasks
1611	HyperConformer: Multi-head HyperMixer for Efficient Speech Recognition	➖
893	Memory-Augmented Conformer for Improved End-To-End Long-form ASR
552	Towards Effective and Compact Contextual Representation for Conformer Transducer Speech Recognition Systems	➖

Speaker Recognition

🆔	Title	Repo	Paper
1294	An Enhanced Res2Net with Local and Global Feature Fusion for Speaker Verification
1286	A Study on Visualization of Voiceprint Feature	➖
1083	VoxTube: A Multilingual Speaker Recognition Dataset
1298	Visualizing Data Augmentation in Deep Speaker Recognition	➖
1565	Ordered and Binary Speaker Embedding	➖
2031	Self-FiLM: Conditioning GANs with Self-Supervised Representations for Bandwidth Extension based Speaker Recognition	➖
1202	Curriculum Learning for Self-Supervised Speaker Verification	➖
1558	Introducing Self-Supervised Phonetic Information for Text-Independent Speaker Verification	➖
1379	A Teacher-Student Approach for Extracting Informative Speaker Embeddings from Speech Mixtures	➖
1479	Experimenting with Additive Margins for Contrastive Self-Supervised Speaker Verification	➖

Cross-lingual and Multilingual ASR

🆔	Title	Repo	Paper
1630	Fast and Efficient Multilingual Self-Supervised Pre-training for Low-Resource Speech Recognition	➖
1338	UniSplice: Universal Cross-Lingual Data Splicing for Low-Resource ASR	➖
772	Allophant: Cross-Lingual Phoneme Recognition with Articulatory Attributes
97	Phonetic-assisted Multi-Target Units Modeling for Improving Conformer-Transducer ASR System	➖
1061	Comparison of Multilingual Self-Supervised and Weakly-Supervised Speech Pre-training for Adaptation to Unseen Languages	➖
1444	DistilXLSR: A Light Weight Cross-Lingual Speech Representation Model

Voice Conversion