Abhinav Sarkar
d758dc3310
Changes dimension table population query for coalesce changes.
...
- Replaces "IS NOT DISTICNT FROM" with "="
- Adds not-all-columns-null check for full refresh.
2015-12-29 16:22:58 +05:30
Abhinav Sarkar
ad14698ab0
Refactoring.
2015-12-29 15:19:17 +05:30
Abhinav Sarkar
bcd210e7a5
Moves SQL type defaults to input json from code.
2015-12-28 22:06:44 +05:30
Abhinav Sarkar
8a530618e4
Fixes incremental SQL for coaleasce changes.
2015-12-28 18:43:49 +05:30
Abhinav Sarkar
3978f33cd0
Adds coalescing to default values for fact table columns.
...
- Removes FKs from fact tables
- Some coercions in SQL for faster processing
2015-12-28 18:09:02 +05:30
Abhinav Sarkar
b994955399
Adds coalescing to default values for dimension table columns.
2015-12-24 17:42:47 +05:30
Abhinav Sarkar
ff4ca5e235
Adds sql generation for count distinct fact columns population.
2015-12-22 19:46:37 +05:30
Abhinav Sarkar
2dcbe4efd7
Adds source column to count and count distinct fact columns.
...
Also removes CountDistinctColumSuffix setting.
2015-12-21 22:19:54 +05:30
Abhinav Sarkar
d1e1eb7676
Adds output json generation.
...
- JSON files are generated for the following:
- list of fact tables generated
- list of dimension tables generated
- dependencies between the fact, dimension and source tables
2015-12-21 15:30:23 +05:30
Abhinav Sarkar
7d64ffcde4
Adds incremental refresh sql generation for fact tables.
2015-12-20 18:25:14 +05:30
Abhinav Sarkar
7dc6db944f
Adds incremental refresh sql generation for dimension tables.
...
- Adds partial unique indexes for tables to handle null columns.
- Adds validation for time column in fact tables.
2015-12-19 11:55:08 +05:30
Abhinav Sarkar
f8a6382aa3
Fixes bugs in fact table DDL and insert SQL generation.
2015-12-18 17:00:46 +05:30
Abhinav Sarkar
c430e5f255
Refactoring.
2015-12-18 13:20:35 +05:30
Abhinav Sarkar
a84325cb2a
Makes the build work with stack lts-2.
2015-12-18 02:37:17 +05:30
Abhinav Sarkar
ea9e100f8f
Extracts constants in code to settings.
2015-12-18 01:33:06 +05:30
Abhinav Sarkar
21497269ee
Adds index SQL in fact table create SQL.
2015-12-17 23:48:17 +05:30
Abhinav Sarkar
900b4b7488
Adds fact table insert SQL generation.
2015-12-16 16:57:10 +05:30
Abhinav Sarkar
c39916704e
Refactoring
2015-12-16 03:14:04 +05:30
Abhinav Sarkar
041d55f9dd
Refactors to move validation logic to its own namespace
2015-12-16 02:07:37 +05:30
Abhinav Sarkar
6e1341b52a
Adds dimension table insert SQL generation.
...
Moves some private functions from Extractor to Extractor.Internal for reuse.
2015-12-15 18:22:51 +05:30
Abhinav Sarkar
6d8e32950f
Adds SQL generation for table definitions.
...
And moves dimension and fact extraction logic to Ringo.Extractor namespace.
2015-12-15 17:22:45 +05:30
Abhinav Sarkar