Media import/export specs
"Modern" media specs
This is my current "media spec" that I use with Blender (since that's all I use these days).
| Reference footage | Video | Container | MP4 |
|---|---|---|---|
| Codec | H.264 | ||
| Audio | Any, preferably none | ||
Reference footage usually I get off of yt-dlp. They might be
in webm, which is fine (except, I think, in 2.79), but when I process these with other
sources I render it out as an MP4.
| Sound track | Codec | FLAC | |
|---|---|---|---|
I process the sound track separately, usually with Audacity. I apply the usual restoration tricks: noise removal, source stitching (for instance, to combine low frequency and high frequency content), equalizing, and so on.
| Materials | Vector | SVG | |||
|---|---|---|---|---|---|
| Raster | Container | OpenEXR | PNG | WebP, if supported | |
| Codec | DWAA, DWAB | - | - | ||
| Color space | RGB(A) or Non-color | RGB(A) | RGB(A) | ||
Vector materials are usually SVG curves exported off of Inkscape.
I try to minimize the use of textures (mainly because I'm lazy) and would prefer to replicate with the Shader Editor. But if I must, I trust OpenEXR textures enough. However I really end up accepting PNG and WebP because that's what the Internet supports. As usual however, 2.79 does not support WebP. At least, last I checked.
| Intermediary render | Video | Container | OpenEXR image sequence |
|---|---|---|---|
| Codec | DWAA or DWAB, minimum quality | ||
| Color space | RGB(A) | ||
| Audio | None | ||
-
Rendering as an image sequence allows me to continue rendering where I left off.
-
The use of OpenEXR does not clip color values. Seems like The Right Thing To Do™
-
I don't often find myself caring that much about detail, so I just use DWA(A|B) to hopefully keep the size manageable.
| Final render | Video | Container | MP4 video |
|---|---|---|---|
| Codec | H.264 | ||
| Color space | RGB | ||
| Audio | Codec | AAC | |
| Sample rate | 44.1K or 48K | ||
| Bit rate | 384 kbps |
"Legacy" media specs
Now let's see what I could work with when dealing with legacy software. These are rougher notes compared to the "Modern" one, and these can change any time.
Let's see what the old guys can handle. These commercial guys pay patents of course, so what do we have?
| After Effects 7 | Sony Vegas 6 |
|---|---|
|
Import [aaf] After Effects [aep aet] [bmp rle dib] Camera [tif crw nef raf orf mrw dcr mos raw pef srf dng x3f cr2 erf] Cineon [cin dpx] ElectricImage [img ei] Filmstrip [flm] [flc fli] [iff tdi] Illustrator [ai pdf] Postscript [eps] [jpg jpe jpeg] Maya [ma] [omf] OpenEXR [exr] [pcx] Photoshop [psd] PICT [pct] Pixar [pxr] [png] Premiere [prproj ppj] Quicktime [mov] AIFF [aif] Flash [swf] [gif] DV Video [dv] Radiance [hdr rgb xyz] [rla rpf] SGI [sgi bw rgb] Softimage PIC [pic] Targa [tga vda icb vst] TIFF [tif tiff] [avi] [wav] MPEG-2 [mpg mpeg m2v m2t] [mp3] [mpa] Windows Media [wmv wma] Export GIF BMP Cineon IMAGE FLC/FLI Filmstip IFF JPEG MP3 MPEG2(-DVD) OMF OpenEXR PCX PICT PNG Photoshop Pixar QuickTime Radiance RealMedia SGI TIFF Targa AVI WAV Windows Media |
Import (some of these need activation lol) CD Audio [cda] [aif aiff snd] Dialogic VOX [vox] [gif] Intervoice [ivc] [jpg jpe jpeg] MPEG-1 [mpg mpeg mmv m1p m1a mp1 mp2 mpa] MPEG-2 [mpg mpeg mmv m2p m2a mp1 mp2 mpa m2t] [mp3] Sun [au snd] Vorbis [ogg] Photoshop [psd] [png] QuickTime [mov qt dv] TIFF [tif] [wav] [swf] Sonic Foundry [sfa] Sony DSR-DU1 [dlx] Sony Perfect Clarity Audio [pca] Wave64 [w64] Sound Designer 1 [dig sd] Targa [tga targa] [avi] [wav] [bmp dib] Windows Media [wma wmv asf] Export AIFF Dolby AC-3 MPEG-1 MPEG-2 MP3 Vorbis QuickTime mov RealMedia rm WAV PCA W64 AVI WMA WMV |
So at this point the following is apparent:
-
Both can import image sequences fine, although Vegas is limited to just JPEG and PNG as you might expect.
-
Vegas 6 can't export image sequences at all.
-
Only format I can use with any clarity is AVI. And there had better be usable codecs that don't take a fuck ton of disk space.
So let's try these ones…
| Reference footage | Video | Container | AVI |
|---|---|---|---|
| Codec | x264vfw (Zero Latency) | ||
| Audio | None | WAV (16-bit signed LE) |
The same thing, just a different video container. Vegas is infamously picky, even if x264vfw ~ Xvid ~ DivX, it wants to see an H264 identifier, which only x264vfw can do. The Zero Latency option
makes it so that the audio doesn't go out of sync, which it otherwise often does.
When using ffmpeg:
ffmpeg \
-i SOURCE \
-c:v libx264 \
-crf 23 \
-c:a pcm_s16le \
DEST.avi
Using the LAME mp3 encoder doesn't work for some reason, despite Vegas recognizing it as "Lame MP3".
Using -c:v copy doesn't work, as it will use avc1. Forcing -vtag H264 requires a -bsf:v h264_mp4toannexb, and applying it anyway results in a corrupted video stream when opened in Vegas.
| Sound track | Codec | WAV | MP3 | |
|---|---|---|---|---|
WAV as it's in the same category as FLAC. But MP3 for the compression rate—obviously in a high bit rate.
| Materials | Vector | EPS | |||
|---|---|---|---|---|---|
| Raster | Container | PNG | OpenEXR | ||
| Codec | - | ZIP(?) | |||
| Color space | RGB(A) | RGB(A) or Non-color | |||
I can export EPS from Inkscape and AE7 seems to open it just fine.
| Intermediary render | Video | Container | OpenEXR seq. | PNG seq. |
|---|---|---|---|---|
| Codec | - | - | ||
| Color space | RGB(A) | RGB(A) | ||
| Audio | None | |||
This I think only applies to AE7. I don't know yet what (if any) codec does the EXR export end up using, but I'll probably try something else if it ends up not being Satisfactory.
| Final render | Video | Container | AVI video | |
|---|---|---|---|---|
| Codec | x264vfw, DivX, Xvid, anything H.264-shaped | |||
| Color space | RGB | |||
| Audio | Codec | MP3 | WAV | |
| Sample rate | 44.1K or 48K | |||
The old AE7 doesn't have an option to change the audio codec, it will always be WAV.
By the by… I think this is the spec I used back then:
| The Render™ | Video | Container | AVI | ||
|---|---|---|---|---|---|
| Codec | Uncompressed 💀💀 | Cinepak | DivX? | ||
| Color space | RGB | ||||
| Audio | Codec | WAV | MP3 | ||
| Sample rate | Probably 44.1K | ||||