List of codecs

The following is a list of compression formats and related codecs.

Audio compression formats

[edit]

Non-compression

[edit]

Lossless compression

[edit]

Lossy compression

[edit]

General/Speech hybrid

[edit]

Neural audio codecs

[edit]

General

[edit]
AES3
[edit]
  • SMPTE 302M
    • FFmpeg (decoder only)
  • Dolby E
    • FFmpeg (decoder only)
Bluetooth
[edit]
Digital radio
[edit]

Voice

[edit]

(low bit rate, optimized for speech)

Microsoft DirectPlay
[edit]

Those codecs are used by many PC games which use voice chats via Microsoft DirectPlay API.

  • Voxware MetaVoice
    • Windows Media Player (voxmvdec.ax)
  • Truespeech
    • Windows Media Player (tssoft32.acm)
    • FFmpeg (decoder only)
  • MS GSM
    • Windows Media Player (msgsm32.acm)
    • libgsm
    • FFmpeg (decoder only)
  • MS-ADPCM
    • Windows Media Player (msadp32.acm)
    • FFmpeg
Digital Voice Recorder
[edit]
  • International Voice Association (IVA) standards:
    • Digital Speech Standard / Standard Play (DSS-SP)
      • FFmpeg (decoding only)
    • Digital Speech Standard / Quality Play (DSS-QP)
  • Sony LPEC
  • Truespeech Triple Rate CODER (TRC)[23] – used in some pocket recorders
  • Micronas [de] Intermetall MI-SC4 - used by voice recorders such as RadioShack Digital Recorder[24] and I-O DATA [ja] HyperHyde[25]
    • FFmpeg (decoder only)
Mobile phone
[edit]
Generation 2
[edit]
Generation 3/4
[edit]
  • 3rd Generation Partnership Project (3GPP)
    • Adaptive Multi-Rate (AMR)
      • AMR-NB
        • 3GPP TS 26.073 – AMR speech Codec (C-source code) – reference implementation[26]
        • opencore-amr (one may compile ffmpeg with—enable-libopencore-amrnb to incorporate the OpenCORE lib)
        • FFmpeg (by default decoder only, but see above the compiling options to incorporate the OpenCORE lib)
      • AMR-WB
        • 3GPP TS 26.173 – AMR-WB speech Codec (C-source code) – reference implementation[11]
        • opencore-amr (decoder), from OpenCORE (one may compile ffmpeg with—enable-libopencore-amrwb to incorporate the OpenCORE lib)
        • vo-amrwbenc (encoder), from VisualOn, included in Android (one may compile ffmpeg with—enable-libvo-amrwbenc to incorporate the VisualOn lib)
        • FFmpeg (by default decoder only, but see above the compiling options).
      • AMR-WB+
        • 3GPP TS 26.273 – AMR-WB+ speech Codec (C-source code) – reference implementation[27]
      • Enhanced Voice Services (EVS)
        • 3GPP TS.26.443 – Codec for Enhanced Voice Services (EVS) – ANSI C code (floating-point)[28]
  • 3rd Generation Partnership Project 2 (3GPP2)
Professional mobile radio
[edit]
  • APCO
    • Project 25 Phase 2 Enhanced Full-Rate (AMBE+2 4400bit/s with 2800bit/s FEC)
    • Project 25 Phase 2 Half-Rate (AMBE+2 2450bit/s with 1150bit/s FEC) – also used in NXDN and DMR
      • mbelib (decoder only)
    • Project 25 Phase 1 Full Rate (IMBE 7200bit/s)
      • mbelib (decoder only)
  • European Telecommunications Standards Institute (ETSI)
    • ETS 300 395-2 (TETRA ACELP 4.6kbit/s)
  • TETRAPOL
    • RPCELP 6 kbit/s
  • D-STAR Digital Voice (AMBE 2400bit/s with 1200bit/s FEC)
    • mbelib (decoder only)
  • Professional Digital Trunking System Industry Association (PDT Alliance) standards:
    • NVOC – used in China
  • Spirit DSP RALCWI
  • DSPINI
    • SPR Robust
    • TWELP Robust
  • Codec2
    • libcodec2
  • RL-CELP (used in Japanese railways[29][30])
Military
[edit]

Video games

[edit]
  • Bink Audio, Smacker Audio
    • FFmpeg (decoder only)
  • Actimagine (Nintendo European Research & Development) FastAudio[32]
    • MobiclipDecoder (decoder only)
    • FFmpeg (decoder only)
  • Nintendo GCADPCM[33] (a.k.a. DSP ADPCM or THP ADPCM) - used in GameCube, Wii and Nintendo 3DS.
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg (decoder only)
  • Sony VAG[33] (a.k.a. Sony PSX ADPCM)
    • vgmstream (decoder only)
    • FFmpeg (decoder only)
  • Sony HEVAG[33] - used in PS Vita.[34]
    • vgmstream (decoder only)
  • Sony ATRAC9[33] - used in PS4 and PS Vita.
    • VGAudio (decoder only)
    • FFmpeg (decoder only)
  • Microsoft XMA[33] - WMA variants for Xbox 360 hardware decoding.[35]
    • FFmpeg (decoder only)
  • Xbox ADPCM
    • vgmstream (decoder only)
    • FFmpeg (decoder only)
  • CRI ADX ADPCM
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg
  • CRI HCA/HCA-MX - used in CRI ADX2 middleware.[36]
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg (decoder only)
    • libcgss
    • HCADecoder (decoder only)
  • FMOD FADPCM[37]
    • vgmstream (decoder only)

Text compression formats

[edit]

Video compression formats

[edit]
  • RGB 4:4:4 (only linear, transfer-converted and bit-reduced also sort of compression up to about 3:1 for HDR)
  • YUV 4:4:4/4:2:2/4:1:1/4:2:0 (all lower 4:4:4 is spatially compressed up to 2:1 for 4:2:0 with specific colour distortions).
    • Intel IYUV
  • 10-bit uncompressed video
  • Composite digital signal - used by SMPTE D-2 and D-3 broadcast digital videocassettes
  • Avid DNxUncompressed (SMPTE RDD 50)
  • V210 - defined by Apple and used by Serial digital interface Input/output video cards[38]

Analog signals

[edit]

Lossless video compression

[edit]
  • ITU-T/ISO/IEC standards:
  • IETF standards:
    • FFV1 (RFC 9043)[43]  – FFV1's compression factor is comparable to Motion JPEG 2000, but based on quicker algorithms (allows real-time capture). Written by Michael Niedermayer and published as part of FFmpeg under GNU LGPL.
      • FFmpeg
  • SMPTE standards:
    • VC-2 HQ lossless (a.k.a. Dirac Pro lossless)
      • libdirac
      • libschroedinger
  • Alparysoft Lossless Video Codec (Alpary)
  • Apple Animation (QuickTime RLE)
    • QuickTime
    • FFmpeg
  • ArithYuv
  • AV1
  • AVIzlib
    • LCL (VfW codec) MSZH and ZLIB[44]
    • FFmpeg
  • Autodesk Animator Codec (AASC)
    • FFmpeg (decoder only)
  • CAI Format
  • CamStudio GZIP/LZO
    • FFmpeg (decoder only)
  • Chennai Codec (EVX-1)
    • Cairo Experimental Video Codec (open source)
  • Dxtory
    • FFmpeg (decoder only)
  • FastCodec
  • Flash Screen Video v1/v2[45]
    • FFmpeg
  • FM Screen Capture Codec
    • FFmpeg (decoder only)
  • Fraps codec (FPS1)[46]
    • FFmpeg (decoder only)
  • Grass Valley Lossless
    • Grass Valley Codec Option
    • FFmpeg (decoder only)
  • Huffyuv Huffyuv (or HuffYUV) was written by Ben Rudiak-Gould and published under the terms of the GNU GPL as free software, meant to replace uncompressed YCbCr as a video capture format. It uses very little CPU but takes a lot of disk space. See also ffvhuff which is an "FFmpeg only" version of it.
    • FFmpeg
  • IgCodec
  • Intel RLE
  • innoHeim/Rsupport Screen Capture Codec
    • FFmpeg (decoder only)
  • Lagarith A more up-to-date fork of Huffyuv is available as Lagarith[47]
    • Lagarith Codec (VfW codec)
    • FFmpeg (decoder only)
  • LOCO[48] - based on JPEG-LS
    • FFmpeg (decoder only)
  • MagicYUV[49]
    • MagicYUV SDK
    • FFmpeg
  • Microsoft RLE (MSRLE)
    • FFmpeg
  • MSU Lossless Video Codec
  • MSU Screen Capture Lossless
  • CorePNG [de] - based on PNG
    • FFmpeg
  • ScreenPresso (SPV1)
    • FFmpeg (decoder only)
  • ScreenPressor[50] - a successor of MSU Screen Capture Lossless
    • FFmpeg (decoder only)
  • SheerVideo
    • FFmpeg (decoder only)
  • Snow lossless
    • FFmpeg
  • TechSmith Screen Capture Codec (TSCC)[51]
    • EnSharpen Video Codec for QuickTime
    • FFmpeg (decoder only)
  • Toponoky
  • Ut Video Codec Suite[52][53]
    • libutvideo
    • FFmpeg
  • VBLE[54]
    • FFmpeg (decoder only)
  • VMnc VMware screen codec[55] - used by VMware Workstation
    • FFmpeg (decoder only)
  • VP9 by Google[56]
    • libvpx
    • FFmpeg (decoder only)
  • YULS
  • ZeroCodec
    • FFmpeg (decoder only)
  • ZMBV (Zip Motion Block Video) Codec - used by DOSBox
    • FFmpeg

Lossless game codecs

[edit]
  • DXA
    • ScummVM Tools (encoder only)
    • FFmpeg (decoder only)

Lossy compression

[edit]

General

[edit]

AI-based / AI-enhanced video codecs

[edit]
  • AIVC[64]
  • Deep Render codec[65][66]
  • MPAI
    • AI-Enhanced Video Coding (MPAI-EVC; under development)
    • AI-based End-to-End Video Coding (MPAI-EEV; under development)

Scalable / Layered

[edit]

VP8,[67] VP9,[67] AV1,[67] and H.266/VVC support scalable modes by default.

  • ITU-T/ISO/IEC standards:
    • Scalable Video Coding (H.264/SVC; H.264/MPEG-4 AVC Annex G; an extension of H.264/MPEG-4 AVC)
    • Scalable High Efficiency Video Coding (SHVC; an extension of H.265/HEVC)
    • Low Complexity Enhancement Video Coding (LCEVC; MPEG-5 Part 2)
      • LCEVC Decoder SDK (open source; decoder only)
      • V-Nova LCEVC SDK
  • SMPTE standards
    • VC-4 Layered Video Extension (SMPTE ST 2058-1:2011)

Intra-frame-only

[edit]
  • Motion JPEG
    • FFmpeg
    • Morgan Multimedia M-JPEG[68]
    • Pegasus PICVideo M-JPEG
    • MainConcept M-JPEG
  • ISO/IEC standard
    • Motion JPEG 2000 (ISO/IEC 15444-3, ITU-T T.802)
      • libopenjpeg
      • FFmpeg
      • Morgan Multimedia M-JPEG2000[69]
      • Morgan Multimedia dcpPlayer (decoder only)[70]
    • JPEG XS (ISO/IEC 21122) Lightweight Low latency video codec
      • intoPIX fastTICO-XS[71]
    • DV (IEC 61834)
      • FFmpeg
    • MPEG-4 SStP (ISO/IEC 14496-2)
    • Motion JPEG XR (ISO/IEC 29199-3, ITU-T T.833)
    • Animated JPEG XL (ISO/IEC 18181)
  • Apple ProRes 422/4444
    • FFmpeg
  • Apple Intermediate Codec
    • FFmpeg (decoder only)
  • Apple Pixlet
    • FFmpeg (decoder only)
  • AVC-Intra
    • x264 (encoder only)
    • FFmpeg (decoder only)
  • AVC-Ultra – a subset of MPEG-4 AVC Hi444PP profile
  • XAVC-I
  • CineForm HD
    • CineForm-SDK  – developed by GoPro (open source)
    • FFmpeg
  • SMPTE standard
    • VC-2 SMPTE standard (a.k.a. Dirac Pro. SMPTE ST 2042)
      • Schrödinger
      • dirac-research
      • VC-2 Reference Encoder and Decoder  – developed by BBC (open source)
      • FFmpeg (the encoder only supports VC-2 HQ profile)
    • VC-3 SMPTE standard (SMPTE ST 2019)
    • VC-5 SMPTE standard (SMPTE ST 2073; a superset of CineForm HD)
    • VC-6 SMPTE standard (SMPTE ST 2117-1)
      • V-Nova VC-6 SDK
  • Grass Valley HQ/HQA/HQX
    • Grass Valley Codec Option
    • FFmpeg (decoder only)
  • NewTek NT25
  • NewTek SpeedHQ - used in Network Device Interface (NDI) protocol
    • NewTek Codec[74]
    • FFmpeg

Stereoscopic 3D / Multiview

[edit]
  • Multiview Video Coding
  • Multiview High Efficiency Video Coding (MV-HEVC; an extension of H.265/HEVC)
    • FFmpeg (decoder only)

Security and surveillance cameras

[edit]
  • Guobiao standards (GB/T)
    • AVS-S-P2 (suspended[75])
    • SVAC (GB/T 25724-2010)
  • Infinity CCTV Codec (IMM4/IMM5/IMM6)
    • FFmpeg[76][77] (IMM4 and IMM5 decoder only)
[edit]
  • CDXL codec
    • FFmpeg (decoder only)
  • Cinepak[78] (a.k.a. Apple Compact Video)
    • FFmpeg
  • Photo CD codec
    • FFmpeg (decoder only)
  • MotionPixels - used in MovieCD
    • FFmpeg (decoder only)
  • CD+G (CD+Graphics) codec
    • FFmpeg (decoder only)
    • VLC (decoder only)
  • CD+EG (CD+Extended Graphics) codec

Network video codecs

[edit]

Bayer video codecs

[edit]
  • CinemaDNG (created by Adobe; used in Blackmagic cameras)
  • Redcode RAW (used in RED cameras) – a modified version of JPEG 2000[81]
    • libredcode
  • ArriRaw (used in Arri cameras)
  • Cineform RAW (used in Silicon Imaging cameras)
    • CineForm-SDK
  • Blackmagic RAW (used in Blackmagic cameras)
    • Blackmagic RAW SDK
  • Cintel RAW (used in Cintel Scanner[82])
    • FFmpeg (decoder only)
  • Apple ProRes RAW
  • intoPIX TICO RAW[83]
    • intoPIX fastTICO-RAW SDK & TICO-RAW FPGA/ASIC libraries[84]
  • Canon CRX - used in Canon Cinema Raw Light movie
    • Canon RAW Plugin for Avid Media Access
    • LibRaw (decoder only; open source)

Video games

[edit]

Real-time

[edit]
  • RivaTuner video codec (RTV1/RTV2)
    • FFmpeg (RTV1 decoder only)
  • Hap/Hap Alpha/Hap Q
    • VIDVOX hap codec
    • FFmpeg
  • DXV Codec
    • Resolume DXV Codec
    • FFmpeg
  • NotchLC
    • FFmpeg (decoder only)
  • VESA Display Stream Compression (DSC)
  • VESA Display Compression-M (VDC-M)

See also

[edit]

References

[edit]
  1. ^ FLAC (Free Lossless Audio Codec), Version 1.1.2 Library of Congress
  2. ^ "About lossless audio in Apple Music". 25 October 2021.
  3. ^ "BFDLAC: A Fast lossless Audio Compression Algorithm For Drum Sounds" (PDF).
  4. ^ Matsui, Emiko (2023-09-19). "Huawei L2HC 3.0 delivers 1.5Mbps lossless sound quality, 4X faster than Apple's AAC". Huawei Central. Retrieved 2024-04-29.
  5. ^ "Lossless Audio Homepage". www.lossless-audio.com.
  6. ^ Shorten Lossless Audio Compression Format (SHN), Version 3.5.1 Library of Congress
  7. ^ "RK Audio - Hydrogenaudio Knowledgebase". wiki.hydrogenaud.io.
  8. ^ FFmpeg 7.1 Released With VVC Decoder Promoted To Stable, Vulkan H.264/H.265 Encode. Phoronix. 30 September 2024.
  9. ^ IPMR Speech Codec - draft-spiritdsp-ipmr-01.txt IETF
  10. ^ TeamSpirit Voice&Video Engine PC. Spirit DSP
  11. ^ a b c 3GPP (2008-12-11) 3GPP TS 26.173 - AMR-WB speech Codec; version 8.0.0 Release 8, retrieved 2009-09-09
  12. ^ Release of sbc-1.1, BlueZ Project, April 30, 2013
  13. ^ PulseAudio 15 Released With Bluetooth Improvements, Better Hardware Support. Phoronix. July 28, 2021
  14. ^ PipeWire: Bluetooth support status update. Collabora. April 29, 2022
  15. ^ a b Integration of the aptX and aptX-HD codecs for A2DP source, Android Open Source Project, January 4, 2017
  16. ^ The contribution of LDAC encoder, Android Open Source Project, January 10, 2017
  17. ^ "What is LHDC". hwa-audio. Retrieved 2019-04-30.
  18. ^ "What is LLAC™?". LHDC org.[dead link]
  19. ^ Speex Audio Codec, Version 1.2 Library of Congress
  20. ^ a b c d e f Finding voice codecs for free software. Linux.com. October 14, 2005
  21. ^ SILK Speech Codec - draft-vos-silk-02 IETF
  22. ^ Constrained-Energy Lapped Transform (CELT) Codec - draft-valin-celt-codec-02 IETF
  23. ^ "DSP Group Unveils Total Telephony Solutions(TM) For Digital Cordless Telephony Applications". Archived from the original on August 23, 2016. Retrieved June 24, 2015.
  24. ^ RadioShack Digital Recorder OWNER'S MANUAL p.38. RadioShack. 2002.
  25. ^ HyperHyde Operation Manual. p.40. I-O DATA. 2000.
  26. ^ 3GPP (2008-12-11) 3GPP TS 26.073 - AMR speech Codec; version 8.0.0 Release 8, retrieved 2009-09-08.
  27. ^ 3GPP (2008-12-18) 3GPP TS 26.273 - AMR-WB+ speech Codec; version 8.0.0 Release 8, retrieved 2009-09-09
  28. ^ 3GPP TS 26.443. Codec for Enhanced Voice Services (EVS); ANSI C code (floating-point).
  29. ^ INFORMATION COLLECTION SURVEY FOR THE MEGA MANILA SUBWAY PROJECT IN THE REPUBLIC OF THE PHILIPPINES Japan International Cooperation Agency September, 2015
  30. ^ 東北上越新幹線デジタル列車 無線システムの開発 (in Japanese) East Japan Railway Company 2003
  31. ^ Obranovich, Charles R.; Golusky, John M.; Preuss, Robert D.; Fabbri, Darren R.; Cruthirds, Daniel R.; Aylward, Erin M.; Freebersyser, James A.; Kolek, Stephen R. (2010). "300 BPS noise robust vocoder". 2010 - Milcom 2010 Military Communications Conference. pp. 298–303. doi:10.1109/MILCOM.2010.5680311. ISBN 978-1-4244-8178-1. S2CID 8991597.
  32. ^ Actimagine allège le multimédia sur les terminaux portables (in French), IT Industrie & Technologies, June 25, 2004
  33. ^ a b c d e AudioCompressionFormat, Unity Technologies
  34. ^ Audio Clip, Unity Technologies
  35. ^ Differences Between Windows and Xbox 360, Microsoft
  36. ^ 【ひらブラ vol.37】音数を諦めず/音質を妥協せず/負荷を極小にする方法(iOS&Android) (in Japanese), Kadokawa Dwango, September 26, 2014
  37. ^ FMOD Studio 1.06 and FMOD at GDC expo program announced, Gamasutra, February 17, 2015
  38. ^ Faster professional 10-bit video conversions. Open Broadcast Systems
  39. ^ "Lossless". x265.readthedocs.io.
  40. ^ "HEVC Decoding". x265.
  41. ^ "FFmpeg Now Supports HEVC/H.265 Decoding". phoronix.
  42. ^ "Encode/H.265". FFmpeg.
  43. ^ Niedermayer, Michael; Rice, Dave; Martinez, Jérôme (August 2021). "rfc9043 - FFV1 Video Coding Format Version 0, 1, and 3". datatracker.ietf.org.
  44. ^ "Lossless Codec Libraries". multimedia.cx.
  45. ^ "FFmpeg: libavcodec/flashsv.c File Reference". ffmpeg.org.
  46. ^ "FRAPS show fps, record video game movies, screen capture software". www.fraps.com.
  47. ^ "Lagarith Lossless Video Codec". lags.leetcode.net.
  48. ^ "LOCO - MultimediaWiki". wiki.multimedia.cx.
  49. ^ "MagicYUV – Lossless video codec".
  50. ^ "ScreenPressor by Infognition - lossless video codec for screen capture". infognition.com.
  51. ^ "Downloads". TechSmith.
  52. ^ "#534 (Ut Video Support) – FFmpeg". ffmpeg.org.
  53. ^ "Ut Video Codec Suite - a new lossless video codec for Windows! [Archive] - Doom9's Forum". doom9.org.
  54. ^ "VBLE - MultimediaWiki". wiki.multimedia.cx.
  55. ^ "VMware Video". multimedia.cx.
  56. ^ "The WebM Project - VP8 Encode Parameter Guide". webmproject.org.
  57. ^ Medoff, Norman; Fink, Edward J. (September 10, 2012). Portable Video: ENG & EFP. CRC Press. p. 221. ISBN 9781136047701.
  58. ^ Samuelsson, J. and P. Hermansson (July 2, 2018). "The xvc video codec". datatracker.ietf.org.
  59. ^ Fuldseth, Arild; Bjontegaard, Gisle; Midtskogen, Steinar; Davies, Thomas; Zanaty, Mo (October 31, 2016). "Thor Video Codec". tools.ietf.org.
  60. ^ "Live demonstration". Forbidden.
  61. ^ Indeo Video Codec, Version 3 Library of Congress
  62. ^ Indeo Video Codec, Version 5 Library of Congress
  63. ^ Sorenson Video Codec, Version 3 Library of Congress
  64. ^ What Is AI Video Compression?. MASV. January 5, 2023
  65. ^ Streamers look to AI to crack the codec code. International Broadcasting Convention. 25 June 2024
  66. ^ Intel Ignite Selects Startups for Spring ’23 Cohorts. Intel
  67. ^ a b c Scalable Video Coding (SVC) Extension for WebRTC - 4. Operational model, World Wide Web Consortium, September 26, 2020
  68. ^ "M-JPEG Codec". Montpellier, France: Morgan Multimedia. Retrieved April 28, 2018.
  69. ^ "M-JPEG2000 Codec". Montpellier, France: Morgan Multimedia. Retrieved April 28, 2018.
  70. ^ "dcpPlayer". Montpellier, France: Morgan Multimedia. Retrieved April 28, 2018.
  71. ^ "FastTICO-XS Codec". Mont-Saint-Guibert, Belgium: intoPIX.
  72. ^ FFmpeg-cvslog - mpeg4video: Add support for MPEG-4 Simple Studio Profile., FFmpeg Project, April 2, 2018
  73. ^ FFmpeg Adds Support For Animated JPEG-XL, Phoronix, June 8, 2023
  74. ^ NewTek Codec Notes NewTek
  75. ^ Achievement, Audio Video Coding Standard Workgroup of China
  76. ^ FFmpeg-cvslog - avcodec: add IMM4 decoder, FFmpeg Project, August 21, 2018
  77. ^ FFmpeg-cvslog - avcodec: add IMM5 decoder, FFmpeg Project, August 29, 2019
  78. ^ Cinepak Library of Congress
  79. ^ SunVideo Plus for PCI User's Guide - Audio Video Conferencing. Oracle
  80. ^ vic: Change History. Lawrence Berkeley National Laboratory
  81. ^ libredcode
  82. ^ Cintel Scanner p.35. Blackmagic Design. May, 2020.
  83. ^ intoPIX Tico Raw is a format with a huge potential
  84. ^ intoPIX Tico Raw
  85. ^ 独自コーデックを搭載したニンテンドーDS版Sofdec (in Japanese) CRI Middleware, May 11, 2006
  86. ^ CRI・ミドルウェア、ゲーム開発者向けブログ「CRIチャンネル」を開設 (in Japanese) Impress Watch Corporation, April 19, 2007