![]() | |
![]() |
| | Thread Tools | Display Modes |
#1
| |||
| |||
|
#2
| |||
| |||
|
|
Like most users I have a database with a few dimension tables and one fact table. I add new data to both the fact table and dimension tables as the day goes on. As soon as data is added to the fact and dimension tables, the users pick up the scent of new data and want to see it ASAP. I have a SSIS package that creates a new partition for the new data and sets the filter appropriately. So what exactly do I need to process? Do I need to process the partition AND the dimensions? Can I just process the dimensions since they seem to process the partitions anyway? Is there an easier way? A few facts: Data is only ever added to the fact and dimension tables - never deleted or udpated. I'm not married to the idea of creating a new partition with every new chunk of data that I get. Thanks, SmartGuy |
#3
| |||
| |||
|
|
Normally, you would ProcessAdd or ProcessUpdate the affected dimension(s) and you would ProcessAdd to the last partition. On a regular basis you may create a new partition so that the older data goes into a static partition. It's not so easy to do ProcessAdd on a dimension (setting it up can be tricky) -- but if your dimensions aren't tremendously large it's usually fine to do ProcessUpdate. ProcessUpdate will scan all your dimension data again, but it lets you keep the partition data without reprocessing. HTH, Akshai -- This posting is provided "AS IS" with no warranties, and confers no rights Please do not send email directly to this alias. This alias is for newsgroup purposes only. "SmartGuy" <SmartGuy (AT) discussions (DOT) microsoft.com> wrote in message news:C1E371E1-6348-46BB-9AB9-54CCBA9A50F0 (AT) microsoft (DOT) com... Like most users I have a database with a few dimension tables and one fact table. I add new data to both the fact table and dimension tables as the day goes on. As soon as data is added to the fact and dimension tables, the users pick up the scent of new data and want to see it ASAP. I have a SSIS package that creates a new partition for the new data and sets the filter appropriately. So what exactly do I need to process? Do I need to process the partition AND the dimensions? Can I just process the dimensions since they seem to process the partitions anyway? Is there an easier way? A few facts: Data is only ever added to the fact and dimension tables - never deleted or udpated. I'm not married to the idea of creating a new partition with every new chunk of data that I get. Thanks, SmartGuy |
#4
| |||
| |||
|
|
Thanks for the info. Our dimension are very large - it takes 30 mins to process them, so ProcessAdd may be what I need to do. Where can I read up on ProcessAdd and/or find code samples? -- SmartGuy "Akshai Mirchandani [MS]" wrote: Normally, you would ProcessAdd or ProcessUpdate the affected dimension(s) and you would ProcessAdd to the last partition. On a regular basis you may create a new partition so that the older data goes into a static partition. It's not so easy to do ProcessAdd on a dimension (setting it up can be tricky) -- but if your dimensions aren't tremendously large it's usually fine to do ProcessUpdate. ProcessUpdate will scan all your dimension data again, but it lets you keep the partition data without reprocessing. HTH, Akshai -- This posting is provided "AS IS" with no warranties, and confers no rights Please do not send email directly to this alias. This alias is for newsgroup purposes only. "SmartGuy" <SmartGuy (AT) discussions (DOT) microsoft.com> wrote in message news:C1E371E1-6348-46BB-9AB9-54CCBA9A50F0 (AT) microsoft (DOT) com... Like most users I have a database with a few dimension tables and one fact table. I add new data to both the fact table and dimension tables as the day goes on. As soon as data is added to the fact and dimension tables, the users pick up the scent of new data and want to see it ASAP. I have a SSIS package that creates a new partition for the new data and sets the filter appropriately. So what exactly do I need to process? Do I need to process the partition AND the dimensions? Can I just process the dimensions since they seem to process the partitions anyway? Is there an easier way? A few facts: Data is only ever added to the fact and dimension tables - never deleted or udpated. I'm not married to the idea of creating a new partition with every new chunk of data that I get. Thanks, SmartGuy |
![]() |
| Thread Tools | |
| Display Modes | |
| |