[ aeprojects.biz ] AE PROJECTS - Questions and Answers

Questions and Answers - OpenGL

Troubleshoot OpenGL problems in After Effects CS3

This document can help you to resolve problems related to OpenGL that occur while you use Adobe After Effects CS3. OpenGL problems can manifest in many different ways, including (but not limited to) the following:

* After Effects crashes or closes without an error while it starts.
* A crash or freeze when you scrub the timeline or preview or render a composition.
* A crash when you change the settings of an effect while OpenGL previews are enabled.
* A crash or freeze when you enable or disable OpenGL previews.
* The composition window takes a long time to redraw.
* Artifacts or blocks of "garbage" pixels are drawn in the composition window.
* The composition window is drawn significantly different between when OpenGL previews are on and off.
* An error message such as one of the following:
" After Effects warning: A problem occurred when processing OpenGL commands."
"The instruction at '0x00fe1940' referenced memory at '0x000000000' The memory could not be 'read'."
"AE_OpenGL: failed to generate shadow map (5065::0)"
"This composition is too complex for the OpenGL hardware."
"After Effects error: AE_OpenGL: Create texture error. (5065 :: 0)"

For information about how to configure the preview preferences in After Effects for OpenGL and a list features in After Effects supported by OpenGL, see "Render With OpenGL" in the Rendering and Exporting section of After Effects Help.

A note to Mac OS X users: You will need to install the After Effects CS3 8.0.1 update and be using Mac OS X 10.4.10 or higher in order to support OpenGL. For the newest MacBook Pros with NVIDIA display chipsets, you will also need to install the MacBook Pro Software Update from Apple. To download and install the After Effects CS3 8.0.1 update, start After Effects CS3, then choose Help > Updates. To download Mac OS updates, choose Software Update from the Apple menu.

To benefit most from this document, perform the tasks in order. Keep track of the tasks that you perform and the results of each, including errors and other problems. Adobe Technical Support can use this information to better assist you if you need to call.

You must be logged on as an administrator to perform some of the procedures in this document.

For Windows XP and Windows Vista, Some of these procedures require you to locate hidden files and hidden folders. Some procedures require you to locate files by their full file names, which include extensions (for example, example_filename.ini). By default, Windows Explorer doesn't show hidden files, hidden folders, and file name extensions that it recognizes.

For Windows XP, to show hidden files, hidden folders, and all filename extensions in Windows Explorer:

1. In Windows Explorer, choose Tools > Folder Options.
2. Click the View tab in the Folder Options dialog box.
3. In Advanced Settings, select Show Hidden Files And Folders.
4. Deselect Hide File Extensions For Known File Types.
5. Click OK.

For Windows Vista, to show hidden files, hidden folders, and all file name extensions in Windows Explorer:

1. In Windows Explorer, choose Organize > Folder And Search Options.
2. Click the View tab in the Folder Options dialog box.
3. In Advanced Settings, select Show Hidden Files And Folders.
4. Deselect Hide Extensions For Known File Types.
5. Click OK.

For Windows Vista, the steps in this document that refer to the Control Panel are in reference to the Classic view. For information on switching the Control Panel to the Classic view and many other common OS procedures, see document kb401275, "Common Microsoft Windows Vista procedures".

These tasks can help you resolve the most common problems with OpenGL. Before performing any of these tasks, back up all personal files (for example, After Effects files you created). Always restart the computer after a system error occurs to refresh its memory. Continuing to work without restarting the computer may compound the problem.
1. Make sure that the system meets the minimum requirements for After Effects.

After Effects may not run correctly on a system that doesn't meet the following requirements:

Mac OS:

Note: For OpenGL support on Mac OS X, the After Effects CS3 8.0.1 update and Mac OS X10.4.10 are required.

* PowerPC G4 or G5 or multicore Intel processor
* Mac OS X v.10.4.9
* 1GB of RAM for DV; 2GB of RAM for HDV and HD
* 3GB of available hard-disk space plus 2GB of space for optional content (additional free space required during installation)
* 1024x768 monitor resolution with 32-bit video card; Adobe recommended graphics card for GPU-accelerated playback
* For OpenGL support: Adobe After Effects supported OpenGL 2.0 card (NVIDIA recommended)
* DVD-ROM drive
* QuickTime 7.1.5 software required to use QuickTime features
* Internet or phone connection required for product activation

To check how much RAM is installed, choose About This Mac from the Apple menu. The Memory value indicates the amount of installed RAM.

Note: After Effects CS3 provides limited support for OpenGL 1.5 on Macintosh computers with PowerPC processors. OpenGL features that require OpenGL 2.0 are not available, including motion blur, antialiasing, and accelerated effects.

Windows:

* Intel® Pentium 4, Intel Centrino, Intel Xeon, or Intel Core Duo (or compatible) processor
* Microsoft Windows XP with Service Pack 2 or Windows Vista Home Premium, Business, Ultimate, or Enterprise (certified for 32-bit editions)
* 1GB of RAM for DV; 2GB of RAM for HDV and HD
* 3GB of available hard-disk space plus 2GB of space for optional content (additional free space required during installation)
* 1024x768 monitor resolution with 32-bit video card; Adobe recommended graphics card for GPU-accelerated playback
* For OpenGL support: Adobe After Effects supported OpenGL 2.0 card (NVIDIA recommended)
* DVD-ROM drive
* QuickTime 7.1.5 software required to use QuickTime features
* Internet or phone connection required for product activation

To check basic system information, such as processor speed and how much RAM is installed, choose Start > Control Panel > System.

Note: If you are using Windows Vista and your computer's video card uses a chipset manufactured by ATI, OpenGL previews may be automatically disabled. Install the After Effects CS3 8.0.1 update and make sure that you are using the ATI Catalyst 7.6 driver or later. Visit www.ati.com for driver information. To download and install the After Effects CS3 8.0.1 update, launch After Effects CS3, then choose Help > Updates. To enable Open GL previews in After Effects, choose Edit > Preferences > Previews, and check the Enable OpenGL option.
2. Install the most recent After Effects CS3 update.

The After Effects CS3 8.0.1 update enables support for OpenGL on Mac OS X 10.4.10 and provides other enhancements for OpenGL on both Mac OS and Windows. To download and install the After Effects CS3 8.0.1 update, launch After Effects CS3, then choose Help > Updates.
3. Make sure that the video card and drivers meet the OpenGL requirements.

To use OpenGL in After Effects, you?ll need an OpenGL card that supports OpenGL 2.0 and has Shader support and support for NPOT (Non Power of Two) textures. If your card supports only OpenGL 1.5, limited OpenGL acceleration will be available in After Effects. If your card does not support OpenGL 1.5 or higher, no OpenGL acceleration will be available in After Effects.

To determine what version of OpenGL your card supports, click on the OpenGL Info button in the Preview preferences. On Mac OS, choose After Effects > Preferences > Previews. On Windows, choose Edit > Preferences > Previews.

For information regarding specific OpenGL hardware, visit the After Effects OpenGL support page on the Adobe website..

Newer video card drivers may improve the OpenGL capabilities of your card. See step 6: Update the video card driver.
4. Disable OpenGL to determine if it is causing the problem.

To disable OpenGL previews:

1. Choose After Effects > Preferences > Previews (Mac OS) or Edit > Preferences > Previews (Windows).
2. Uncheck Enable OpenGL.

Note: OpenGL does not support some features in After Effects, and the appearance of your composition can change between using OpenGL previews and software-rendered previews. In particular, OpenGL does not support 3D motion blur, layer styles, and some effects. Also, highlights may be clipped in 32-bpc mode when OpenGL is enabled. To avoid seeing these problems, disable OpenGL. For the list features that are supported by OpenGL, see "Render With OpenGL" in the Rendering and Exporting section of After Effects Help.
5. Remove the OpenGL plug-in from the After Effects plug-ins folder.

To determine if the problem is caused by OpenGL, remove the OpenGL plug-in and restart After Effects.

To remove the OpenGL plug-in:

1. Quit After Effects.
2. Mac OS: Drag the AE_OpenGL.plugin file from the Applications/Adobe After Effects CS3/Plug-ins/Extensions folder to the desktop.
Windows: Drag the AE_OpenGL.AEX file from the C:\Program Files\Adobe\Adobe After Effects CS3\Support Files\Plug-ins\Extensions folder to the desktop.
3. Restart After Effects.

If the problem recurs, it isn't caused by OpenGL. Drag the OpenGL plug-in back to the original location. If the problem doesn't recur, the cause of the problem is OpenGL. See step 5: Update the video card driver.
6. Update the video card driver.

Most OpenGL problems or conflicts are solved by updating the video card driver. Many video card manufacturers frequently update their software drivers. If you haven't recently updated the video card driver, contact the video card manufacturer for an updated driver, or download one from the manufacturer's website. (To determine the manufacturer of a video card, view the card's properties in Device Manager.)
7. Restart After Effects and test the behavior that caused the crash. (Windows only)

Following a crash caused by an OpenGL problem on Windows, After Effects may automatically disable the Prevent DLL Address Space Fragmentation preference. This preference allows After Effects to access a larger amount of contiguous RAM, but may be incompatible with some OpenGL drivers.

You can enable or disable the Prevent DLL Address Space Fragmentation preference by going to Edit > Preferences > Memory & Cache.

You should leave this preference enabled unless you are experiencing OpenGL or memory related crashes. If the preference needs to be disabled due to an OpenGL problem, and you later upate the video card drivers, re-enable the preference and test the problem again.
8. Optimize the Texture Memory preference.

Crashes or OpenGL errors may occur if After Effects attempts to use too much video texture memory. Texture memory is the amount of RAM on the video card (VRAM).

Note: On Mac OS, After Effects calculates and sets the Texture Memory value automatically. In most cases, you won't need to change the Texture Memory value in Mac OS. On Windows, After Effects sets Texture Memory to 95 MB, which you should change to equal 80% of the display card's VRAM.

To set the Texture Memory preference in After Effects:

1. Multiply the total installed VRAM by 80% to calculate the optimal Texture Memory setting.
2. In After Effects, choose After Effects > Preferences >Previews (Mac OS) or Edit > Preferences > Previews (Windows).
3. Click OpenGL Info.
4. Enter the value you calculated in Step 1, then click OK.

The ideal value for texture memory is 80% of the VRAM on your video card. (If you use multiple video cards, calculate 80% of the VRAM on the video card that is identified in the OpenGL Information dialog box.) If the Texture Memory preference in After Effects is set to more than 80% of the VRAM, not enough VRAM may be left over for the video card to handle the user interface or other tasks (for example, the entire screen may turn white). If the value is set to less than 80%, OpenGL previews in After Effects may take longer to process frames.

To determine the amount of VRAM on your card in Mac OS:

1. Choose About This Mac from the Apple menu.
2. Click More Info.
3. Click the triangle next to Hardware to reveal the hardware list.
4. Click PCI/AGP Cards or Graphics/Displays and review the information that appears on the right.

To determine the amount of VRAM on your card in Windows XP:

1. Right-click the desktop and choose Properties.
2. Click the Settings tab.
3. Click Advanced.
4. Click the Adapter tab. This tab displays Adapter information, including Memory Size (VRAM).

To determine the amount of VRAM on your card in Windows Vista:

1. Choose Start > Control Panel.
2. Double click Personalization and select Display Settings.
3. Click Advanced Settings.
4. Click the Adapter tab. This tab displays Adapter information, including Dedicate Video Memory (VRAM).

9. Purge the image caches and video memory.

If After Effects displays artifacts or "garbage" (blocks of incorrect pixels) in the composition window during a preview or when you scrub, the video memory (VRAM) may have become full, fragmented, or corrupted. Purge the image caches and video memory to empty the VRAM and let After Effects rebuild the composition preview.

To purge the image caches, choose Edit > Purge > Image Caches.

To purge the video memory, choose Edit > Purge > Video Memory.

Note: Some screen savers that use OpenGL (or Direct3D on Windows) may corrupt the video memory if they activate while After Effects is running. Change or disable the screen saver if you frequently have problems with corrupted images in the composition window after turning off the screen saver.

10. Change the color setting for the video card to Highest (32 bit) (Windows) or Millions (Mac OS).

See Mac OS Help or Windows Help for information about changing the video card or display settings.
11. Disable advanced functions of the video card. (Windows only)

Most display card drivers include utilities that allow you to access advanced functions of the card. In particular, Antialiasing and 16-bit mode functions may conflict with OpenGL and cause After Effects to crash. Set the advanced functions of the card to their defaults, then disable the Antialiasing and 16-bit mode options.

If you are using multiple monitors with an Nvidia card, set the Multimonitor setting to "Compatible".

Refer to the documentation for the video card or to the manufacturer's web site for instructions on how to access the advanced functions of the video card.
12. Use a single monitor.

If you are using multiple monitors and experience problems with OpenGL in After Effects, try the following:

* If you have placed the After Effects application window or the Composition panel on a secondary monitor, move the window to the primary monitor.
* Disconnect all but one monitor.
* If you are using multiple display cards, remove all but one display card. For best results with OpenGL, use a single dual-head display card.

13. Place the Reduce OpenGL Texture Size script in the Startup scripts folder.

The Reduce OpenGL Texture Size script will reduce the amount of texture memory used by After Effects and may provide better compatibility with older video cards.

To place the Reduce OpenGL Texture Size script in the Startup scripts folder:

1. Navigate to the After Effects scripts folder.
On Mac OS: Applications/Adobe After Effects CS3/Scripts.
On Windows: C:\Program Files\Adobe\Adobe After Effects CS3\Support Files\Scripts.
2. Move the Reduce OpenGL Texture Size.jsx file from the (Protected) folder to the Startup folder.

A newer video card may improve the OpenGL capabilities of your computer and make the script unnecessary. After you install a new card and its drivers, move the Reduce OpenGL Texture Size script back to the (Protected) folder, then reset the After Effects preferences. See step 14: Re-create the After Effects preferences file.
14. Re-create the After Effects preferences file.

Re-create the After Effects preferences file to eliminate problems that damaged OpenGL preferences might cause.

To re-create the After Effects preferences file on Mac OS:

1. Quit After Effects.
2. Drag the Adobe After Effects 8.0 Prefs file from the Users/<username>/Library/Preferences/Adobe/After Effects/8.0 folder to the Trash.
3. Restart After Effects.

To re-create the After Effects preferences file on Windows XP:

1. Quit After Effects.
2. Rename the Adobe After Effects 8.0 Prefs.txt file (for example, toAdobe After Effects 8.0 Prefs.old) in the C:\Documents and Settings\<username>\Application Data\Adobe\After Effects\8.0 folder.
3. Start After Effects. After Effects creates a new preferences file.

To re-create the After Effects preferences file on Windows Vista:

1. Quit After Effects.
2. Rename the Adobe After Effects 8.0 Prefs.txt (for example, to Adobe After Effects 8.0 Prefs.old) in the C:\Users\<username>\AppData\Roaming\Adobe\After Effects\8.0 folder.
3. Start After Effects. After Effects creates a new preferences file.

Note: You cannot use the Render Multiple Frames Simultaneously multiprocessing feature while also using OpenGL to render RAM previews or render for final output. The Render Multiple Frames Simultaneously feature works by using background processes on multiple CPU processor cores to render frames. OpenGL processing uses the GPU.

Hope this makes sense! aeprojects.biz