Data warehousing in the cloud: computer scientists needed

  • user warning: Got error 28 from storage engine query: SELECT t.* FROM drupal_term_node r INNER JOIN drupal_term_data t ON r.tid = t.tid INNER JOIN drupal_vocabulary v ON t.vid = v.vid WHERE r.vid = 71945 ORDER BY v.weight, t.weight, t.name LIMIT 0, 1 in /var/www/dikutal.dk/sites/all/modules/pathauto/pathauto.module on line 142.
  • user warning: Got error 28 from storage engine query: SELECT DISTINCT t.* FROM drupal_term_node r INNER JOIN drupal_term_data t ON r.tid = t.tid INNER JOIN drupal_vocabulary v ON t.vid = v.vid LEFT JOIN drupal_forum_access fa ON t.tid = fa.tid LEFT JOIN drupal_acl acl_fa ON acl_fa.name = t.tid AND acl_fa.module = 'forum_access' LEFT JOIN drupal_acl_user aclu_fa ON aclu_fa.acl_id = acl_fa.acl_id AND aclu_fa.uid = 0 WHERE ((fa.grant_view >= 1 AND fa.rid IN (1)) OR fa.tid IS NULL OR aclu_fa.uid = 0) AND ( r.vid = 32162 )ORDER BY v.weight, t.weight, t.name in /var/www/dikutal.dk/modules/taxonomy/taxonomy.module on line 632.
Skrevet af ngws, 28. august 2013 - 23:14
Dato: 
19. September 2013 - 15:15 - 17:00

Principal Consultants Kennie Nybo Pontoppidan, Peter Hansen and Morten Lobedanz Sørensen from Rehfeld gives this double talk. Everybody is welcome.

Warning: there might be bits and bytes…

Five years ago not many of us dreamed that office applications would be available in the cloud. Now we use all Google Apps or Office 365 in one way or another. In Rehfeld we work with Business Intelligence and the foundation for this is a sound data warehouse. We believe that data warehousing in the cloud will become a next big thing within the next five years, but before then we need your help. The traditional performance bottlenecks in data warehousing is usually I/O bound. Data warehousing in the cloud will suffer from different performance bottlenecks, probably network bandwidth and latency. Because of this we might also need new semantic models for eventual consistency, perhaps with QoS on when data is available after replication.

The first part of today's talk will be an introduction to a traditional data warehouse architecture, including ETL processes (Extract, Transform, Load). Then in the second part we will introduce the challenges of ETL processes when your source systems are in the cloud. We hope that the audience will participate in joint discussions of potential research projects and/or research areas for computer scientist students and staff. We believe that computer science can bring something interesting to the table in an area which until recently was very well understood.