Abhinav Sarkar
0d5e1ff29f
Adds indexes on dimension table columns in SQL.
2016-01-06 19:00:27 +05:30
Abhinav Sarkar
6a107aaf8d
Changes dimension populatation generator to use hssqlppp internally.
2016-01-04 01:32:36 +05:30
Abhinav Sarkar
4fe1006d0c
Makes tests run only on ghc 7.10.
...
- doctest is unable to resolve cabal macros on ghc 7.8 so disabling
tests on ghc 7.8.
2016-01-02 02:59:24 +05:30
Abhinav Sarkar
2be336ba41
Changes travis config to run tests
2016-01-01 21:02:10 +05:30
Abhinav Sarkar
c021ffb845
Adds doctests.
2016-01-01 20:57:54 +05:30
Abhinav Sarkar
28ff8a99fb
Changes Create generator to use hssqlppp internally.
2016-01-01 17:15:22 +05:30
Abhinav Sarkar
e2ecfc0b9b
Adds a dependency on hssqlppp.
2016-01-01 14:31:46 +05:30
Abhinav Sarkar
4e4d13b94f
Adds support for generated table suffixes and time where clause on source table in full refresh mode.
2015-12-30 19:57:38 +05:30
Abhinav Sarkar
644acc7ee9
Moves out foreign key id coalesce value as a setting.
2015-12-30 12:34:35 +05:30
Abhinav Sarkar
dc4b260ff6
Refactoring.
2015-12-30 12:21:41 +05:30
Abhinav Sarkar
f00f158578
Changes dependency version limits for building in stackage nightly.
2015-12-30 00:36:53 +05:30
Abhinav Sarkar
b030df010b
Adds travis build status image
2015-12-30 00:33:09 +05:30
Abhinav Sarkar
3958b00b87
Adds travis CI integration.
2015-12-30 00:19:57 +05:30
Abhinav Sarkar
601eed9a3c
Changes count distinct algo to use a specialized int log2 function.
2015-12-29 18:22:01 +05:30
Abhinav Sarkar
2d5a49f53e
Refactoring: Breaks Ringo.Generator into small modules.
2015-12-29 17:11:15 +05:30
Abhinav Sarkar
87a787ba8f
Moves type default value validations to run only on DimVal and NoDimId fact column.
...
Instead of running on all columns.
2015-12-29 16:24:40 +05:30
Abhinav Sarkar
d758dc3310
Changes dimension table population query for coalesce changes.
...
- Replaces "IS NOT DISTICNT FROM" with "="
- Adds not-all-columns-null check for full refresh.
2015-12-29 16:22:58 +05:30
Abhinav Sarkar
aeed16570e
Makes NoDimId columns in extracted fact tables not nullable.
2015-12-29 16:21:52 +05:30
Abhinav Sarkar
8f27bdf33c
Fixes swapped dimension and fact json file names.
2015-12-29 15:19:55 +05:30
Abhinav Sarkar
ad14698ab0
Refactoring.
2015-12-29 15:19:17 +05:30
Abhinav Sarkar
bcd210e7a5
Moves SQL type defaults to input json from code.
2015-12-28 22:06:44 +05:30
Abhinav Sarkar
8a530618e4
Fixes incremental SQL for coaleasce changes.
2015-12-28 18:43:49 +05:30
Abhinav Sarkar
3978f33cd0
Adds coalescing to default values for fact table columns.
...
- Removes FKs from fact tables
- Some coercions in SQL for faster processing
2015-12-28 18:09:02 +05:30
Abhinav Sarkar
b994955399
Adds coalescing to default values for dimension table columns.
2015-12-24 17:42:47 +05:30
Abhinav Sarkar
ff4ca5e235
Adds sql generation for count distinct fact columns population.
2015-12-22 19:46:37 +05:30
Abhinav Sarkar
2dcbe4efd7
Adds source column to count and count distinct fact columns.
...
Also removes CountDistinctColumSuffix setting.
2015-12-21 22:19:54 +05:30
Abhinav Sarkar
d1e1eb7676
Adds output json generation.
...
- JSON files are generated for the following:
- list of fact tables generated
- list of dimension tables generated
- dependencies between the fact, dimension and source tables
2015-12-21 15:30:23 +05:30
Abhinav Sarkar
7d64ffcde4
Adds incremental refresh sql generation for fact tables.
2015-12-20 18:25:14 +05:30
Abhinav Sarkar
7dc6db944f
Adds incremental refresh sql generation for dimension tables.
...
- Adds partial unique indexes for tables to handle null columns.
- Adds validation for time column in fact tables.
2015-12-19 11:55:08 +05:30
Abhinav Sarkar
e46d3684cd
Fixes a typo.
2015-12-18 17:35:26 +05:30
Abhinav Sarkar
068190b520
Adds brew install command in setup instructions.
2015-12-18 17:12:13 +05:30
Abhinav Sarkar
f8a6382aa3
Fixes bugs in fact table DDL and insert SQL generation.
2015-12-18 17:00:46 +05:30
Abhinav Sarkar
4a07d0c828
Adds setup instructions to the README.
2015-12-18 14:00:18 +05:30
Abhinav Sarkar
c430e5f255
Refactoring.
2015-12-18 13:20:35 +05:30
Abhinav Sarkar
a84325cb2a
Makes the build work with stack lts-2.
2015-12-18 02:37:17 +05:30
Abhinav Sarkar
ea9e100f8f
Extracts constants in code to settings.
2015-12-18 01:33:06 +05:30
Abhinav Sarkar
21497269ee
Adds index SQL in fact table create SQL.
2015-12-17 23:48:17 +05:30
Abhinav Sarkar
c3d3019cd3
Adds SQL file generation to the executable
2015-12-17 23:18:12 +05:30
Abhinav Sarkar
4a5233a1a2
Adds the ability to run as an executable.
...
- Adds a parser to parse yaml file into tables and facts
- Adds program argument handling for specifying program settings
2015-12-17 20:02:13 +05:30
Abhinav Sarkar
900b4b7488
Adds fact table insert SQL generation.
2015-12-16 16:57:10 +05:30
Abhinav Sarkar
c39916704e
Refactoring
2015-12-16 03:14:04 +05:30
Abhinav Sarkar
f016f0de09
Adds Tables file to gitignore
2015-12-16 02:20:26 +05:30
Abhinav Sarkar
041d55f9dd
Refactors to move validation logic to its own namespace
2015-12-16 02:07:37 +05:30
Abhinav Sarkar
6e1341b52a
Adds dimension table insert SQL generation.
...
Moves some private functions from Extractor to Extractor.Internal for reuse.
2015-12-15 18:22:51 +05:30
Abhinav Sarkar
6d8e32950f
Adds SQL generation for table definitions.
...
And moves dimension and fact extraction logic to Ringo.Extractor namespace.
2015-12-15 17:22:45 +05:30
Abhinav Sarkar
3d00a89062
Changes to use Reader monad
2015-12-15 11:59:53 +05:30
Abhinav Sarkar
b7d13c4947
Refactoring
2015-12-14 23:10:54 +05:30
Abhinav Sarkar
8e74c20705
Adds fact table extraction function
2015-12-14 21:57:11 +05:30
Abhinav Sarkar
9107b7c83d
Adds validation and dimension extraction functions.
2015-12-10 20:30:55 +05:30
Abhinav Sarkar
048b19d4d2
Adds table related types and some example tables.
2015-12-10 20:29:26 +05:30