SAP can be implemented with a variety of RDBMS'. You need to use the ODBC driver for Oracle or whatever RDBMS your SAP is using. Normally, the application administrators forbid accessing SAP tables directly. The table structure is overly complex and in many cases you're better off using their extract mechanism.
