Data Sources

It is rare today to find an enterprise that uses a single data source to house all their production data. We can provide data adapters to capture changed data for all major data sources. Glenridge data adapters utilize a log-based, real-time Change Data Capture (CDC) software platform that captures and delivers only the changes made to enterprise data sources, operational and transaction systems.

The low-impact, non-intrusive architecture of Glenridge adapters:
» Eliminates the need for bulk data updates/refreshes
» Frees up valuable batch windows
» Enables real-time data integration and event processing initiatives
» Supports mini-batch, micro-batch
» Provides continuous processing of change events/records

These are the same proven adapters resold by major software companies available from us at fraction of the cost of what those major software companies would charge you.

Mainframe	Windows/ UNIX	HP Non Stop	OpenVMS	AS/400
Adabas DB2 IMS/DB VSAM	Adabas Oracle 9, 10, 11 SQL Server 2000 SQL Server 2005 SQL Server 2008	Escribe SQL/MP	Adabas	DB2/400

Real-time Change Data Capture (CDC) This process captures only the changes made to underlying source systems, eliminating the need for periodic batch jobs and freeing up valuable batch windows. The changes are stored in "Change Tables", one change table for each of your application database tables. BIMarts also applies a serialization process that allows the BIMarts Sync Engine to detect changes in the source table structures. For example, source table structures such as added or dropped columns or changes in data type or size. The value of Change Data Capture (CDC) CDC allows IT managers to address many of the information management challenges, some of which are listed above, as well as new trends and requirements: Delivers data on-demand and in near real-time, providing business users with the most current information supporting tactical and operational BI applications. Dramatically increases efficiencies by moving only the data that has changed and addressing the growth in data volumes with continuous data feeds that can be filtered and scheduled based on needs and requirements Reduces the impact on your nightly batch cycle as data is captured and processed while the systems keep working. Provides a comprehensive platform that works with other integration products and can be used for many initiatives, including BI/DW, CPM, BAM, Migrations, Consolidations, and others.

Apply Change Activity to the ODS

The BIMarts Change Data Capture (CDC) engine picks up the changes stored in the change tables by the CDC process and applies those changes to the Operational Data Store (ODS). The update cycle is throttled based on the schedule you specify.

End-of-Day Synchronization Process

The changes applied to the ODS are applied to the appropriate tables in the data warehouse. This is typically done in a batch cycle at the end of the day. Changes may be applied to certain tables, however, you may choose to apply changes to certain tables on a more frequent basis. BIMarts also supports these incremental updates throughout the day.

BIMarts Internal Data Warehouse
The internal data warehouse functions more like a conventional OLTP database and as such is tuned like its application database counterpart. This means Database Administrators do not need to learn new tuning skills. It also means that the database does not need to be compromised to handle both the conventional Insert, Update, and Delete operations as well as the types of mass queries that typify a data warehouse.

Synchronizing the Internal DW to the User DW
The delta of change to the Internal Data Warehouse and associated star schemas is applied to the User Data Warehouse. This greatly narrows the window of time when a data warehouse is unavailable to your user community.

High Availability
The last step of the nightly update process is to apply the delta of change in the Internal Data warehouse to the User Data Warehouse and associated star schemas. This greatly narrows the window of time when your data warehouse is unavailable to your user community.

Non-Stop Availability
Alternatively, you can mirror servers and databases and have the delta of change applied to one server while the other server supports users. Then, when the update completes successfully, the more current server becomes the primary server to support users and brings the secondary server to the same level of currency.

The User Data Warehouse
The delta of change to the Internal Data Warehouse and associated star schemas is applied to the User Data Warehouse. This greatly narrows the window of time when your data warehouse is unavailable to your user community.

High Availability
The last step of the nightly update process is to apply the delta of change in the Internal Data warehouse to the User Data Warehouse and associated star schemas. This greatly narrows the window of time when your data warehouse is unavailable to your user community.

Non-Stop Availability
Optionally you can mirror servers and databases and have the delta of change applied to one server while the other server supports users. Then, when the update completes successfully, the more current server becomes the primary server to support users and brings the secondary server to the same level of currency.

Technology that enables you to work smarter, not harder!

Decipher Meta Data Toolkit Decipher is the meta data management component . It is a knowledge engineered data mart generator built by subject matter experts that can be implemented and supported by your staff. Using Decipher, your existing staff will be able to GENERATE data marts based solely on meta data. Projects that would take months to build using SQL code and Extract, Transformation, and Load (ETL) tools, may be completed in just days. While the underlying technology is quite sophisticated, the simplicity of the user interface is remarkable. BIMarts does not require the user to have the advanced training and years of experience required by ETL tools or 3rd generation languages, yet yields many times the benefits of using such tools. Learn more about Decipher: Departmental Level Enterprise Level Generated Data Marts Integrated Data Marts Star Schemas

No Black Box Code!

Database Server Component The BIMarts database server component utilizes the meta data output from the Decipher module to: Synchronize the ODS to the source application database(s) Synchronize the data warehouse to with the ODS Update the Star Schemas The BIMarts database server component can also detect changes in the table structures of the source database tables and dynamically reconfigure the appropriate components in the data warehouse. In addition, the BIMarts database server component can reconcile the ODS and its associated tables in the data warehouse back to the corresponding tables in your source database down to the table, row, and column level. The BIMarts database server component has been developed using pure PL/SQL code. The actual source code is available to your organization should you require it. This means that your existing DBAs can use their existing tools and skill sets to maintain and tune the performance of the BIMarts database server component.

Real-time Change Data Capture (CDC) This process captures only the changes made to underlying source systems, eliminating the need for periodic batch jobs and freeing up valuable batch windows. The changes are stored in "Change Tables"; 1 change table for each of your application database tables. BIMarts also applies a serialization process that allows the BIMarts Sync Engine to detect changes in the source table structures. For example, if a column was added or dropped or the data type or size was changed. The value of Change Data Capture (CDC) CDC allows IT managers to address many of the information management challenges, some of which are listed above, as well as new trends and requirements: Delivers data on-demand and in near real-time, providing business users with the most current information supporting tactical and operational BI applications. Dramatically increases efficiencies by moving only the data that has changed and addressing the growth in data volumes with continuous data feeds that can be filtered and scheduled based on needs and requirements Reduces the impact on your nightly batch cycle as data is captured and processed while the systems keep working. Provides a comprehensive platform that works with other integration products and can be used for many initiatives, including BI/DW, CPM, BAM, Migrations, Consolidations, and others.