Welcome to dbForumz.com!
FAQFAQ      ProfileProfile    Private MessagesPrivate Messages   Log inLog in

Multiple Publishers, Single Subscriber (Data Warehouse)

 
   Database Forums (Home) -> Replication RSS
Next:  acCmdLinkTables  
Author Message
cpnet

External


Since: Aug 12, 2008
Posts: 6



(Msg. 1) Posted: Tue Nov 11, 2008 10:57 am
Post subject: Multiple Publishers, Single Subscriber (Data Warehouse)
Archived from groups: microsoft>public>sqlserver>replication (more info?)

I'm trying to figure out the best way to populated the staging database in a
data warehouse. I will have a number of databases (identical schema, SQL
Server 2005 Standard). Ideally I'd set up each as a publisher, with the
same publication. There will be a single subscriber database (SQL Server
2005 Enterprise) that will subscribe to each of the publisher databases.
Data in the publisher databases will be modified. The subscriber database
will only be updated by its subscriptions, and therefore does not need to
send changes back to any of the publishers. Publisher databases don't need
to update each other. Replication will be occurring over the internet
(although VPN could be used).

A given table will have 'system' data that's identical in all publisher
databases, and also user-entered data that will be unique to a given
publisher database. I'd like all of this data to be merged into the
subscriber database so that it ends up with a single copy of each record of
system data, and a single copy of of each record of user-entered data. I'm
not clear on what kind of replication I should be using for this.

 >> Stay informed about: Multiple Publishers, Single Subscriber (Data Warehouse) 
Back to top
Login to vote
Charles Wang [MSFT]

External


Since: May 15, 2008
Posts: 58



(Msg. 2) Posted: Wed Nov 12, 2008 1:25 am
Post subject: RE: Multiple Publishers, Single Subscriber (Data Warehouse) [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

Hi cpnet,
Thank you for using Microsoft MSDN Managed Newsgroup. This is Charles. I am glad to work with you on this issue.

From your description, I understand that you would like to establish a replication with a many-to-one relation on publisher and subscriber.
You want all the data from the tables in your publications are merged into one table in your subscription.
If I have misunderstood, please let me know.

You can establish transactional replication for this requirement, however since you need to replicate many tables from different
publications to one single table in a subscriber, you need to ensure that all the publications and the subscription initially have the same
status before synchronization. Considering duplicate records may exist, I do not recommend that you apply any constraint on your
subscription table. You may consider to timely move the data from the subscription table to another table in your subscription on which you
can apply constraints and create indexes.

To configure a replication, you can refer to the following articles:
How to: Configure Distribution (SQL Server Management Studio)
http://msdn.microsoft.com/en-us/library/ms151192(SQL.90).aspx
How to: Enable a Remote Publisher at a Distributor (SQL Server Management Studio)
http://msdn.microsoft.com/en-us/library/ms151781(SQL.90).aspx
Creating Publications and Defining Articles (SQL Server Management Studio)
http://msdn.microsoft.com/en-us/library/ms152542(SQL.90).aspx
Creating Subscriptions (SQL Server Management Studio)
http://msdn.microsoft.com/en-us/library/ms152503(SQL.90).aspx
Securing a Replication Topology (SQL Server Management Studio)
http://msdn.microsoft.com/en-us/library/ms152554(SQL.90).aspx
Synchronizing Subscriptions (SQL Server Management Studio)
http://msdn.microsoft.com/en-us/library/ms152550(SQL.90).aspx

Hope this helps. If you have any other questions or concerns, please feel free to let me know.

Have a nice day!


Best regards,
Charles Wang
Microsoft Online Community Support
===========================================================
Delighting our customers is our #1 priority. We welcome your
comments and suggestions about how we can improve the
support we provide to you. Please feel free to let my manager
know what you think of the level of service provided. You can
send feedback directly to my manager at: msdnmg DeleteThis @microsoft.com.
===========================================================
Get notification to my posts through email? Please refer to
http://msdn.microsoft.com/subscriptions/managednewsgroups/default.aspx...tificat

Note: MSDN Managed Newsgroup support offering is for non-urgent issues where an initial response from the community or a Microsoft
Support Engineer within 2 business day is acceptable. Please note that each follow up response may take approximately 2 business days as
the support professional working with you may need further investigation to reach the most efficient resolution. The offering is not
appropriate for situations that require urgent, real-time or phone-based interactions. Issues of this nature are best handled working with a
dedicated Microsoft Support Engineer by contacting Microsoft Customer Support Services (CSS) at http://msdn.microsoft.com/en-
us/subscriptions/aa948874.aspx.
============================================================
This posting is provided "AS IS" with no warranties, and confers no rights.
=========================================================

 >> Stay informed about: Multiple Publishers, Single Subscriber (Data Warehouse) 
Back to top
Login to vote
cpnet

External


Since: Aug 12, 2008
Posts: 6



(Msg. 3) Posted: Thu Nov 13, 2008 9:52 am
Post subject: Re: Multiple Publishers, Single Subscriber (Data Warehouse) [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

Thanks Charles.

I had sort of been hoping there would be a built in replication model that
would handle this for me - taking care of duplicated records, primary
(identity keys) and adjusting foreign keys as needed. I'm fairly new to SQL
Server replication and after some reading I see that there isn't support for
this. My current plan is to replicate each publisher database to a
different subscriber database (all subscriber databases will be on the same
server). My data warehouse ETL process will loop through the subscriber
databases and pull the data from each one. (The ETL process will be able to
sort out the duplicate records and can use rowguids in each table rather
than the identity primary keys). This may not be the most efficient long
term solution, but should work for the short term until I can get a better
process in place.
 >> Stay informed about: Multiple Publishers, Single Subscriber (Data Warehouse) 
Back to top
Login to vote
Charles Wang [MSFT]

External


Since: May 15, 2008
Posts: 58



(Msg. 4) Posted: Fri Nov 14, 2008 6:25 am
Post subject: Re: Multiple Publishers, Single Subscriber (Data Warehouse) [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

Hi cpnet,
Yes, this is an advanced complex business requirement and currently the existing SQL Server replications do
not provide built-in functions to support it. Now I also do not see other databases provide such functions to
support it. You may give Microsoft your feedback at https://connect.microsoft.com/sql so that our product
team can hear your voice directly and continuously improve our products in future.

If you decide to use ETL, I think that there are many ways for helping do this. In SQL Server 2005 or 2008, SQL
Server Integration Services (SSIS) is a good choice for this process. After you create a SSIS package, you can
schedule a job to run it. This is quite often used in many applications for data integration.
You may refer to:
Creating a Simple ETL Package Tutorial
http://msdn.microsoft.com/en-us/library/ms169917(SQL.90).aspx
How to: Run a Package Using a SQL Server Agent Job
http://msdn.microsoft.com/en-us/library/ms139805(SQL.90).aspx

If you have any other questions or concerns, please feel free to let me know. Thank you!


Best regards,
Charles Wang
Microsoft Online Community Support
=========================================================
Delighting our customers is our #1 priority. We welcome your
comments and suggestions about how we can improve the
support we provide to you. Please feel free to let my manager
know what you think of the level of service provided. You can
send feedback directly to my manager at: msdnmg RemoveThis @microsoft.com.
=========================================================
This posting is provided "AS IS" with no warranties, and confers no rights.
=========================================================
 >> Stay informed about: Multiple Publishers, Single Subscriber (Data Warehouse) 
Back to top
Login to vote
Display posts from previous:   
   Database Forums (Home) -> Replication All times are: Pacific Time (US & Canada) (change)
Page 1 of 1

 
You can post new topics in this forum
You can reply to topics in this forum
You can edit your posts in this forum
You can delete your posts in this forum
You can vote in polls in this forum



[ Contact us | Terms of Service/Privacy Policy ]