TechWave Home / Conference Content / Conference Tracks / Data Integration, Analysis and Warehousing

Data Integration, Analysis and Warehousing

What follows is a partial and unedited list of sessions selected for this track at TechWave. We are working diligently to finish developing conference content, edit the material and bring the session search application online. In the meantime please feel free to make use of this material. The full schedule should be available soon. Note that this material is subject to change without notice.

Best Practices for Implementing a Warehouse with Sybase IQ
Audience Job Function: Application Developer, DBA, System Analyst, Consultant
Session Duration: 90 minutes
Learning Points You Will Take Away from this Class:
- The basics of proper hardware configuration for Sybase IQ
- How to best implement Sybase IQ from an application standpoint
- How to best implement Sybase IQ from a DBA, standpoint
This presentation focuses on best practices and successful implementations of Sybase IQ. The main focus is on tips and techniques that result in an optimal Sybase IQ warehouse. Topics will include: database creation tips and settings, data types, stored procedure coding, indexes, database settings, hardware considerations, backup and restore, and data model recommendations.

Converting from ASE to IQ, how to convert in 14 easy steps
Audience Job Function: Application Developer, DBA, System Analyst, Object Administrator, Consultant, IS/IT Management, Corporate Management
Session Duration: 90 minutes
Learning Points You Will Take Away from this Class:
- Identify all of the code that will need to be changed in their system.
- Find all of the changes needed to convert their application to fully functional DSS system. This includes creating a work plan of all the necessary steps.
- Work through all of the common problems in converting a front end application to IQ.
Converting to IQ is simple if you follow the steps. This presentation will walk you through the most common steps to convert to IQ. It will list all of the problems and solutions to convert a Decision support system. Sometimes it takes understanding where the standards are a bit "grey" and learning where ASE and IQ differ. The issues that will be covered are: ANSI SQL, group by, order by, cursors, insert statements, Transact SQL, Watcom SQL, temporary tables, error handling, porting schema, Indexing, tips for rewriting SQL, delete statements, outer joins, and data type differences. Once you convert over, you will want to maximize the performance of the DSS system. This presentation will also walk through where to easily improve the system.

Fast Track To Sybase ETL (extract, transform and load)
Audience Job Function: DBA, System Analyst, Consultant, IS/IT Management
Session Duration: 90 minutes
Learning Points You Will Take Away from this Class:
- understand the entire Sybase ETL process that involves extracting data from a variety of sources(ASE/Oracle/MSSQL, etc.), transforming it to meet business needs and loading it into a single repository (Sybase IQ, etc.)
- understand Process Designer which allows users to visually represent transformation flows.
- walk away with confidence understanding how by reducing data transformation costs and streamlining projects, Sybase ETL offers rapid return on investment. It provides improved efficiency and reduced complexity
This hands-on-presentation will discuss and demonstrate the Sybase ETL (extract, transform and load) product which is part of the Sybase Data Integration Suite. The presentation discuss and demonstrates the data consolidation process that involves extracting data from a variety of sources such as ASE or Oracle, transforming it to meet business needs and loading it into a single repository, such as a Sybase IQ data warehouse. The presentation will show step-by-step use of the process designer which allows users to visually represent transformation flows. This presentation will demonstrate how to use the built in functions and commands to enable users to get up and running with their first transformation in less than 10 minutes. The main objective of this presentation will be to show how Sybase ETL via a live demo will be able to reduce data transformation costs and streamline projects and this offer rapid return on investment. The presentation proved that Sybase ETL provides improved efficiency and reduced complexity in the complex world of extract, transform and load. The demo is based on a real world scenario and will transform partial data from a Oracle 10i server, partial data from a ASE 15.2 server in a Sybase IQ 12.7 data warehouse server for reporting and analysis. Users will be able to use this presentation and the demo version of the product in their own shops to replicate this kind of extract, transform and load within minute

In-House IQ Monitoring Facilities
Audience Job Function: DBA
Session Duration: 60 minutes
Learning Points You Will Take Away from this Class:
- Combine IQ and ASA monitoring capabilities to have a one-stop connection level performance monitoring facility
- Show just those connections with running transactions and predict how soon each transaction will take to complete
- Complement Bradmark and native IQ monitoring features to report rejected columns, used tables and columns by parsing IQMSG and SQL log files.
To have an accurate snapshot of running transactions/connections is not a very easy job in IQ. sp_iqcontext and sp_iqconnection display the information for all open connections with their own focuses. sp_iqtransaction provides more details on each transaction but the results are hard to intrepret and link back to connections. Also ASA (IQ's catalog database engine) provides numerous monitoring metrics which may have been overlooked by IQ DBA, s. This paper will discuss a stored procedure developed in house to combine them all to provide a one-stop active connection monitoring, as well as how to deploy it in a way to provide historical monitoring and trending capabilities.

IQ 15.0 - An Overview
Audience Job Function: Application Developer, DBA, System Analyst, Consultant, IS/IT Management, Corporate Management
Session Duration: 60 minutes
Learning Points You Will Take Away from this Class:
- Describe the new features in IQ 15.0
- Describe how these new features will benefit your organization
- Describe how to migrate from 12.6 and 12.7 releases of IQ
The intent of this session is to provide an overview of IQ 15.0 to a an audience with general knowledge of IQ. The session will introduce many of the new features in IQ 15.0 with the assumption: (1) the attendee is interested in a High-Level description of the feature (2) The attendee is interested in a High-Level description of the migration from IQ 12.6 or IQ 12.7 to IQ 15.0 (3) The attendee will seek out details of the feature in a session dedicated to that feature.

IQ User Administration and Security
Audience Job Function: Application Developer, DBA
Session Duration: 90 minutes
Learning Points You Will Take Away from this Class:
- understand the new features that are offered.
- better manage IQ users, authorities, permissions and security
- acquaint yourself with new terminology and concepts
IQ User Administration and Security Abstract: IQ 15.0 has many new features to offer on User Administration and Security. This presentation intends to provide an overall view of these new features and discuss how these affect existing IQ users in simplex and multiplex configurations. New features to be discussed include password policies, account locking, user reports, and managing users across multiple multiplex nodes. Affiliated topics will include the best practices to better manage IQ users and groups. There will be detailed discussion on User IDs, authorities, permissions and security. The presentation will cover a comparison of these practices with the functionality provided in earlier versions of IQ. We will also talk about the upgrade considerations while moving from earlier versions of IQ to IQ 15.0 and features available to users with integrated logins and Kerberos. Detailed Topic list New features overview: - Password change policy - Account locking - Status report Multiplex login Management: - Multiplex node specific user locking - Permissions across the multiplex Benefits in IQ 15.0 features: - No DBA owned tables - Internal Command Processing - Manual Intervention of DBA not required New terminology and concept: - Login policy and options - New DDL commands Recommended practices: - Managing login policies - Managing user permissions and authorities - Using status reports Upgrade considerations.

Manually Implementing Micro-Batch Replication into Sybase IQ
Audience Job Function: DBA, System Analyst, Consultant
Session Duration: 90 minutes
Learning Points You Will Take Away from this Class:
- Understanding of Challenges of Replication to Sybase IQ
- Micro-Batch Replication Techniques
- Scripting Methodology to Implement Sybase IQ Micro-Batch Replication
This session is designed for those Sybase IQ shops that are interested in using Sybase Replication Server to replicate in near-real-time to Sybase IQ. This presentation will be targeted to those shops that have a need to replicate to Sybase IQ, but do not have the Sybase PowerDesigner Information Liquidity Module to automatically create/implement the scripts. We will focus on the manual creation of all scripts required to setup/implement the end-to-end replication environment. We will describe/present/demonstrate the steps to create and implement the scripts for the Replication Server, a Staging ASE Database, and the Sybase IQ target. At the conclusion of this presentation, the audience will have an understanding of the challenges faced with near-real-time replication to Sybase IQ. In addition, the audience will have a step-by-step guide, with examples, on a realistic Micro-Batch replication implementation. The audience should have some prior knowledge of Sybase Replication Server and Sybase IQ .

Oracle to Sybase IQ Migration Guide
Audience Job Function: DBA
Session Duration: 90 minutes
Learning Points You Will Take Away from this Class:
- migrate an Oracle schema to Sybase IQ
- load data from Oracle into Sybase IQ
- keep data up to date in Sybase IQ using replication technology
This presentation describes the generation of an IQ schema from an Oracle schema using PowerDesigner, how to load data using 3 methods (LOAD TABLE, INSERT&LOCATION, and Sybase ETL), and how to keep the data warehouse up to date using Replication Server and a staging database.

Sybase IQ Future Directions
Audience Job Function: Application Developer, DBA, Consultant, IS/IT Management
Session Duration: 60 minutes
Learning Points You Will Take Away from this Class:
- Learn about the significant enhancements being planned for Sybase IQ
- Understand the application and value of the enhancements being planned
- Appreciate the strong commitment from Sybase to further strengthen Sybase IQ
Sybase IQ Future Directions will review the future directions being considered around the Sybase IQ analytics platform. The presentation will articulate the future areas of focus for Sybase IQ that will maintain its leadership position in chosen market segments. Existing customers will benefit through a consideration of the potential technical advancements that they can take advantage of, while prospects and other audience will understand why and how Sybase IQ will continue to transform and meet the needs for analytics business.

Techniques for near real-time data movement into Sybase IQ
Audience Job Function: Application Developer, DBA, System Analyst, Consultant, IS/IT Management
Session Duration: 90 minutes
Learning Points You Will Take Away from this Class:
- How to effectively load data into IQ in a near realtime manner
- Various methods of loading data into IQ
- Pros and cons of load methods and expected performance characteristics
The purpose of this session is to discuss the various mechanisms for loading data into IQ in near real time. In today's constantly changing data landscape, loading data into Sybase IQ becomes much more critical to the success of the business.

What Makes Sybase IQ Different?
Audience Job Function: Application Developer, DBA, System Analyst, Consultant, IS/IT Management
Session Duration: 60 minutes
Learning Points You Will Take Away from this Class:
- Understand how the architecture of Sybase IQ differs from OLTP database such as ASE
- Understand how those differences yeild performance advantages and disadvantages
- Understand how those differences should guide the selection of an appropriate database product for any application
For those familiar with traditional row-oriented OLTP databases such as ASE, this session will help you understand in technical terms how column-oriented databases such as Sybase IQ are different. These architectural differences yield both performance advantages and disadvantages. Knowledge of these differences can then guide you through the decision process of selecting the most appropriate type of database for any application. You will be able to identify whether a column-oriented database or a row-oriented database is more appropriate for an application. You'll also be able to identify when an application is appropriate for either database technology, and therefore other factors should guide the selection process.