SQL Server Integration Services http://sqlmag.com/taxonomy/term/9181/more en ETL in the Cloud with Azure http://sqlmag.com/sql-server-integration-services/etl-cloud-azure <div class="field-byline"> Mark Kromer, Microsoft Azure Cloud Data Solution Architect </div> <div class="field-deck"> Here are a few options for using the Azure platform for ETL </div> <div class="node-body article-body">As you transition your data platform into the Cloud, it will be important to consider options for data movement, transformation and aggregation. Let's take a quick look at a few options that enable Cloud ETL in Azure.</div> <p><a href="http://sqlmag.com/sql-server-integration-services/etl-cloud-azure" target="_blank">read more</a></p> http://sqlmag.com/sql-server-integration-services/etl-cloud-azure#comments SQL Server Integration Services Analytics Azure azure data factory Business Intelligence Business Intelligence Professional cloud Cloud BI DataWarehousing elt ETL Machine Learning Thu, 17 Nov 2016 14:52:00 +0000 34491 at http://sqlmag.com How to Dramatically Decrease Data Warehouse Load Times with Memory-Optimized Tables http://sqlmag.com/sql-server-integration-services/how-dramatically-decrease-data-warehouse-load-times-memory-optimized <div class="field-byline"> Tyler C. </div> <div class="node-body article-body"><p><strong>Introduction</strong></p> <p>Recently, I needed to optimize a nightly batch process for a SQL Server data warehouse that involved loading over 250,000 flat files. &nbsp;With a bit of experimentation and research, I was able to decrease the overall load time from 14 hours to under 15 minutes.&nbsp; To do so, I used:</p> <ul> <li> <p>something <em>old</em> - the T-SQL BULK INSERT command,</p> </li> <li> <p>something <em>new</em> - Memory-Optimized tables in SQL Server 2014, and</p></li></ul></div> <p><a href="http://sqlmag.com/sql-server-integration-services/how-dramatically-decrease-data-warehouse-load-times-memory-optimized" target="_blank">read more</a></p> http://sqlmag.com/sql-server-integration-services/how-dramatically-decrease-data-warehouse-load-times-memory-optimized#comments SQL Server Integration Services Memory Optimized Tables Performance SSIS warehouse Wed, 03 Jun 2015 14:03:00 +0000 24681 at http://sqlmag.com For future Analysis Services development, will you use: http://sqlmag.com/poll/04162015 <div class="node-body advpoll_binary-body"></div><form action="/poll/04162015" accept-charset="UTF-8" method="post" id="advpoll-voting-binary-form-0" class="advpoll-vote"> <div><div class="poll"> <div class="advpoll-available-choices"> <div class="vote-choices"> <div class="form-radios"><div class="form-item" id="edit-choice-1851-wrapper"> <label class="option" for="edit-choice-1851"><input type="radio" id="edit-choice-1851" name="choice" value="1851" class="form-radio" /> Multidimensional</label> </div> <div class="form-item" id="edit-choice-1861-wrapper"> <label class="option" for="edit-choice-1861"><input type="radio" id="edit-choice-1861" name="choice" value="1861" class="form-radio" /> Tabular</label> </div> <div class="form-item" id="edit-choice-1871-wrapper"> <label class="option" for="edit-choice-1871"><input type="radio" id="edit-choice-1871" name="choice" value="1871" class="form-radio" /> Both</label> </div> </div> </div> </div> <input type="hidden" name="ajax" id="edit-ajax" value="" class="ajax" /> <input type="hidden" name="nid" id="edit-nid" value="23971" class="edit-nid" /> <input type="submit" name="op" id="edit-vote-binary-0" value="Answer" class="form-submit" /> <input type="hidden" name="form_build_id" id="form-1p52gZnXFQeiTcLEMqDEBIPl8NJduaHizhIcUUhyI2k" value="form-1p52gZnXFQeiTcLEMqDEBIPl8NJduaHizhIcUUhyI2k" /> <input type="hidden" name="form_id" id="edit-advpoll-voting-binary-form" value="advpoll_voting_binary_form" /> </div> </div></form> http://sqlmag.com/poll/04162015#comments SQL Server Integration Services Thu, 16 Apr 2015 16:41:56 +0000 23971 at http://sqlmag.com Foreign Key Constraints: Friend or Frenemy? http://sqlmag.com/database-performance-tuning/foreign-key-constraints-friend-or-frenemy <div class="field-byline"> Mickey Stuewe </div> <div class="node-body article-body">Let's take a look at a few common bad habits that need to be broken in order to provide better, consistent data and some of the silent killers when foreign key constraints are not added to the database model.</div> <p><a href="http://sqlmag.com/database-performance-tuning/foreign-key-constraints-friend-or-frenemy" target="_blank">read more</a></p> http://sqlmag.com/database-performance-tuning/foreign-key-constraints-friend-or-frenemy#comments Database Performance Tuning SQL Server Integration Services foreign key constraints Foreign Keys tables Fri, 20 Jun 2014 04:00:00 +0000 18451 at http://sqlmag.com Microsoft TechEd 2014: Melissa Data's New De-Duplication Functionality in MatchUp for SSIS http://sqlmag.com/sql-server-integration-services/microsoft-teched-2014-melissa-datas-new-de-duplication-functionality <div class="node-body article-body">Ahead of the Microsoft TechEd 2014 conference, Melissa Data announced that they will be showing off new matching and de-duplication functionality in the company's MatchUp Component for SQL Server Integration Services (SSIS).</div> <p><a href="http://sqlmag.com/sql-server-integration-services/microsoft-teched-2014-melissa-datas-new-de-duplication-functionality" target="_blank">read more</a></p> http://sqlmag.com/sql-server-integration-services/microsoft-teched-2014-melissa-datas-new-de-duplication-functionality#comments SQL Server Integration Services SQL Server Database Administration Melissa Data Melissa Data MatchUp component for SSIS Microsoft SSIS. Microsoft TechEd 2014 news Microsoft TechEd 2014 SQL Server Integration Services Thu, 08 May 2014 13:57:00 +0000 17761 at http://sqlmag.com A Look at the SSIS Object Model http://sqlmag.com/sql-server-integration-services/look-ssis-object-model <div class="field-deck"> Build a custom data flow component </div> <div class="node-body article-body">The object model is the heart of SQL Server Integration Services. As such, it provides a solid base to build custom components. Here are the concepts you need to understand to build a custom data flow component.</div> <p><a href="http://sqlmag.com/sql-server-integration-services/look-ssis-object-model" target="_blank">read more</a></p> http://sqlmag.com/sql-server-integration-services/look-ssis-object-model#comments SQL Server Integration Services SQL Server custom components data flow ETL extraction transformation and loading object model SQL Server Integration Services SSIS Thu, 02 Jan 2014 14:00:00 +0000 15401 at http://sqlmag.com SSIS Deployment Strategy for SQL Server 2012 http://sqlmag.com/sql-server-integration-services/ssis-deployment-sql-server-2012 <div class="field-deck"> How to take advantage of the new SSISDB catalog and database </div> <div class="node-body article-body">By taking advantage of the new SSISDB catalog and database in SQL Server 2012, you can streamline your SSIS deployments and prevent many configuration and deployment problems.</div> <p><a href="http://sqlmag.com/sql-server-integration-services/ssis-deployment-sql-server-2012" target="_blank">read more</a></p> http://sqlmag.com/sql-server-integration-services/ssis-deployment-sql-server-2012#comments SQL Server 2012 SQL Server Integration Services deployment Microsoft SQL Server 2012 SQL Server Integration Services SSIS Mon, 13 May 2013 22:04:00 +0000 12631 at http://sqlmag.com Use SSIS for ETL from Hadoop http://sqlmag.com/blog/use-ssis-etl-hadoop <div class="node-body blog-body">In this blog post, Mark Kromer walks you through using SSIS as a way to use ETL techniques using Microsoft's Hadoop on Windows (HDInsight) as a source using Hive connectors</div> <p><a href="http://sqlmag.com/blog/use-ssis-etl-hadoop" target="_blank">read more</a></p> http://sqlmag.com/blog/use-ssis-etl-hadoop#comments SQL Server Integration Services Apache Hive Apache Hive Business Intelligence business intelligence Business Intelligence Professional data warehouse data warehouse ETL etl Hadoop Hadoop hdinsight hdinsight SSIS SSIS SQL Server BI Blog Wed, 08 May 2013 15:55:00 +0000 12481 at http://sqlmag.com SQL Server 2012 Business Intelligence Enhancements http://sqlmag.com/sql-server-2012/sql-server-2012-business-intelligence-enhancements <div class="field-byline"> James Serra </div> <div class="field-deck"> SQL Server 2012 is a one-stop shop for implementing an end-to-end BI solution </div> <div class="node-body article-body">SQL Server 2012 is a one-stop shop for implementing an end-to-end BI solution. You should upgrade to SQL Server 2012 if you've implemented a BI solution or are interested in implementing one.</div> <p><a href="http://sqlmag.com/sql-server-2012/sql-server-2012-business-intelligence-enhancements" target="_blank">read more</a></p> http://sqlmag.com/sql-server-2012/sql-server-2012-business-intelligence-enhancements#comments SQL Server 2012 SQL Server Analysis Services SQL Server Integration Services SQL Server Reporting Services SQL Server Business Intelligence Business Intelligence Power View PowerPivot for Excel SQL Server SQL Server 2012 SQL Server Analysis Services (SSAS) SQL Server Integration Services (SSIS) SQL Server Reporting Services (SSRS) Mon, 25 Mar 2013 10:00:00 +0000 11741 at http://sqlmag.com Using SSIS to Collect Baseline Data for Merge Replication http://sqlmag.com/sql-server-integration-services/using-ssis-collect-baseline-data-merge-replication <div class="field-byline"> Ted Krueger </div> <div class="field-deck"> Continually monitor performance </div> <div class="node-body article-body">Collecting baseline data for merge replication can help you gain a deeper understanding of how it's performing so that you can prevent problems. With SQL Server Integration Services (SSIS), you can make sure your baseline data is always up-to-date.</div> <p><a href="http://sqlmag.com/sql-server-integration-services/using-ssis-collect-baseline-data-merge-replication" target="_blank">read more</a></p> http://sqlmag.com/sql-server-integration-services/using-ssis-collect-baseline-data-merge-replication#comments Database Performance Tuning SQL Server Integration Services SQL Server Database Administration Administration Tools Data management Database Administration Database management systems Microsoft SQL Server Performance relational database management systems SQL Server SQL Server Integration Services SQL Server Integration Services (SSIS) Sat, 17 Nov 2012 14:21:00 +0000 10089 at http://sqlmag.com