There are no reviews yet. Be the first to send feedback to the community and the maintainers!
LLaMA-Omni
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.StreamSpeech
StreamSpeech is an “All in One” seamless model for offline and simultaneous speech recognition, speech translation and speech synthesis.BayLing
“百聆”是一个基于LLaMA的语言对齐增强的英语/中文大语言模型,具有优越的英语/中文能力,在多语言和通用任务等多项测试中取得ChatGPT 90%的性能。BayLing is an English/Chinese LLM equipped with advanced language alignment, showing superior capability in English/Chinese generation, instruction following and multi-turn interaction.TruthX
Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"awesome-transformer
A collection of transformer's guides, implementations and variants.DialoFlow
Code for ACL 2021 main conference paper "Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterances".NAST-S2x
A fast speech-to-any translation model that supports simultaneous decoding and offers 28× speedup.DASpeech
Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".DSTC8-AVSD
We rank the 1st in DSTC8 Audio-Visual Scene-Aware Dialog competition. This is the source code for our IEEE/ACM TASLP (AAAI2020-DSTC8-AVSD) paper "Bridging Text and Video: A Universal Multimodal Transformer for Video-Audio Scene-Aware Dialog".OR-NMT
Source Code for ACL2019 paper <Bridging the Gap between Training and Inference for Neural Machine Translation>STEMM
Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".DiSeg
Source code for ACL 2023 paper "End-to-End Simultaneous Speech Translation with Differentiable Segmentation"BoN-NAT
Seq-NAT
Source code for <Sequence-Level Training for Non-Autoregressive Neural Machine Translation>.PLUVR
Code for ACL 2022 main conference paper "Neural Machine Translation with Phrase-Level Universal Visual Representations".HMT
Source code for ICLR 2023 spotlight paper "Hidden Markov Transformer for Simultaneous Machine Translation"ComSpeech
Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".TLAT-NMT
Source code for the EMNLP 2020 long paper <Token-level Adaptive Training for Neural Machine Translation>.NMLA-NAT
Code for NeurIPS 2022 Spotlight paper " Non-Monotonic Latent Alignments for CTC-Based Non-Autoregressive Machine Translation"AIH
Code for Findings of ACL 2021 paper "Addressing Inquiries about History: An Efficient and Practical Framework for Evaluating Open-domain Chatbot Consistency".RSI-NAT
Source code for "Retrieving Sequential Information for Non-Autoregressive Neural Machine Translation"DiverseNMT
Source code for the AAAI 2020 long paper <Modeling Fluency and Faithfulness for Diverse Neural Machine Translation>.CMOT
Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"LNMT-CA
Code for EMNLP 2022 main conference paper "Low-resource Neural Machine Translation with Cross-modal Alignment".CRESS
Code for ACL 2023 main conference paper "Understanding and Bridging the Modality Gap for Speech Translation".ITST
Code for EMNLP 2022 main conference paper "Information-Transport-based Policy for Simultaneous Translation"SiLLM
SiLLM is a Simultaneous Machine Translation (SiMT) Framework. It utilizes a Large Language model as the translation model and employs a traditional SiMT model for policy-decision to achieve SiMT through collaboration.TACS
Source code for Truth-Aware Context Selection: Mitigating the Hallucinations of Large Language Models Being Misled by Untruthful ContextsBT4ST
Code for ACL 2023 main conference paper "Back Translation for Speech-to-text Translation Without Transcripts".Dual-Path
Code for ACL 2022 main conference paper "Modeling Dual Read/Write Paths for Simultaneous Machine Translation"NA-MNMT
Source code for "Importance-based Neuron Allocation for Multilingual Neural Machine Translation"Convex-Learning
Code for NeurIPS 2023 paper "Beyond MLE: Convex Learning for Text Generation"GMA
Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"PCFG-NAT
Code for NeurIPS 2023 paper "Non-autoregressive Machine Translation with Probabilistic Context-free Grammar".NAST
Official implementation for EMNLP 2023 paper "Non-autoregressive Streaming Transformer for Simultaneous Translation"COKD
Code for ACL 2022 main conference paper "Overcoming Catastrophic Forgetting beyond Continual Learning: Balanced Training for Neural Machine Translation".MoE-Waitk
Code for EMNLP 2021 oral paper "Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy"DDRS-NAT
Code for NAACL2022 main conference paper "One Reference Is Not Enough: Diverse Distillation with Reference Selection for Non-Autoregressive Translation"SU4MT
Code for EMNLP 2023 paper "Enhancing Neural Machine Translation with Semantic Units"SeerForcingNMT
Source code for "Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation"Zero-MNMT
Multiscale-Contextualization
ACL2024 Integrating Multi-scale Contextualized Information for Byte-based Neural Machine TranslationWait-info
Source code for our EMNLP 2022 paper "Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translation"BS-SiMT
Source code for our ACL 2023 paper "Learning Optimal Policy for Simultaneous Machine Translation via Binary Search"CTC-S2UT
Code for ACL 2024 findings paper "CTC-based Non-autoregressive Textless Speech-to-Speech Translation"GS4NMT
source code for "Greedy Search with Probabilistic N-gram Matching for Neural Machine Translation"DST
DST is a Decoder-only simultaneous machine translation model, which can conduct policy decision and translation concurrentlyLFR-NMT
Source code for the EMNLP 2022 paper "Continual Learning of Neural Machine Translation within Low Forgetting Risk Regions"CPDecoder
optimize the decoder of the neural machine translation model by the cube pruning algorithmnar-tutorial
Slides for NAR tutorialCAPT
Code for EMNLP 2022 main conference paper "Counterfactual Data Augmentation via Perspective Transition for Open-Domain Dialogues".PED-SiMT
Code for "Turning Fixed to Adaptive: Integrating Post-Evaluation into Simultaneous Machine Translation"Glance-SiMT
SAMMT
Code for EMNLP 2023 paper "Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation"RN4NMT
source code for "Refining Source Representations with Relation Networks for Neural Machine Translation".Seg2Seg
Tailored-Ref
Code for EMNLP 2023 paper "Simultaneous Machine Translation with Tailored Reference"SemLing-MNMT
Code for ACL 2024 paper "Improving Multilingual Neural Machine Translation by Utilizing Semantic and Linguistic Features".ComSpeech-Site
corpus_NKD
data repo for "Knowledge Diffusion for Neural Dialogue Generation"TruthX-site
StreamSpeech-site
Rephraser-NAT
Code for AAAI 2023 paper "Rephrasing the Reference for Non-Autoregressive Machine Translation"Auto-RAG
Love Open Source and this site? Check out how you can help us