Commit Graph

103 Commits (a89a3013f9c920c802f9892df4a76755aae79bcd)

Author SHA1 Message Date
Abhinav Sarkar 6ce2d56252 Adds support for tenant id fact column for multi-tenant databse designs. 2016-01-07 02:38:41 +05:30
Abhinav Sarkar 0d5e1ff29f Adds indexes on dimension table columns in SQL. 2016-01-06 19:00:27 +05:30
Abhinav Sarkar 6a107aaf8d Changes dimension populatation generator to use hssqlppp internally. 2016-01-04 01:32:36 +05:30
Abhinav Sarkar 4fe1006d0c Makes tests run only on ghc 7.10.
- doctest is unable to resolve cabal macros on ghc 7.8 so disabling
  tests on ghc 7.8.
2016-01-02 02:59:24 +05:30
Abhinav Sarkar 2be336ba41 Changes travis config to run tests 2016-01-01 21:02:10 +05:30
Abhinav Sarkar c021ffb845 Adds doctests. 2016-01-01 20:57:54 +05:30
Abhinav Sarkar 28ff8a99fb Changes Create generator to use hssqlppp internally. 2016-01-01 17:15:22 +05:30
Abhinav Sarkar e2ecfc0b9b Adds a dependency on hssqlppp. 2016-01-01 14:31:46 +05:30
Abhinav Sarkar 4e4d13b94f Adds support for generated table suffixes and time where clause on source table in full refresh mode. 2015-12-30 19:57:38 +05:30
Abhinav Sarkar 644acc7ee9 Moves out foreign key id coalesce value as a setting. 2015-12-30 12:34:35 +05:30
Abhinav Sarkar dc4b260ff6 Refactoring. 2015-12-30 12:21:41 +05:30
Abhinav Sarkar f00f158578 Changes dependency version limits for building in stackage nightly. 2015-12-30 00:36:53 +05:30
Abhinav Sarkar b030df010b Adds travis build status image 2015-12-30 00:33:09 +05:30
Abhinav Sarkar 3958b00b87 Adds travis CI integration. 2015-12-30 00:19:57 +05:30
Abhinav Sarkar 601eed9a3c Changes count distinct algo to use a specialized int log2 function. 2015-12-29 18:22:01 +05:30
Abhinav Sarkar 2d5a49f53e Refactoring: Breaks Ringo.Generator into small modules. 2015-12-29 17:11:15 +05:30
Abhinav Sarkar 87a787ba8f Moves type default value validations to run only on DimVal and NoDimId fact column.
Instead of running on all columns.
2015-12-29 16:24:40 +05:30
Abhinav Sarkar d758dc3310 Changes dimension table population query for coalesce changes.
- Replaces "IS NOT DISTICNT FROM" with "="
- Adds not-all-columns-null check for full refresh.
2015-12-29 16:22:58 +05:30
Abhinav Sarkar aeed16570e Makes NoDimId columns in extracted fact tables not nullable. 2015-12-29 16:21:52 +05:30
Abhinav Sarkar 8f27bdf33c Fixes swapped dimension and fact json file names. 2015-12-29 15:19:55 +05:30
Abhinav Sarkar ad14698ab0 Refactoring. 2015-12-29 15:19:17 +05:30
Abhinav Sarkar bcd210e7a5 Moves SQL type defaults to input json from code. 2015-12-28 22:06:44 +05:30
Abhinav Sarkar 8a530618e4 Fixes incremental SQL for coaleasce changes. 2015-12-28 18:43:49 +05:30
Abhinav Sarkar 3978f33cd0 Adds coalescing to default values for fact table columns.
- Removes FKs from fact tables
- Some coercions in SQL for faster processing
2015-12-28 18:09:02 +05:30
Abhinav Sarkar b994955399 Adds coalescing to default values for dimension table columns. 2015-12-24 17:42:47 +05:30
Abhinav Sarkar ff4ca5e235 Adds sql generation for count distinct fact columns population. 2015-12-22 19:46:37 +05:30
Abhinav Sarkar 2dcbe4efd7 Adds source column to count and count distinct fact columns.
Also removes CountDistinctColumSuffix setting.
2015-12-21 22:19:54 +05:30
Abhinav Sarkar d1e1eb7676 Adds output json generation.
- JSON files are generated for the following:
 - list of fact tables generated
 - list of dimension tables generated
 - dependencies between the fact, dimension and source tables
2015-12-21 15:30:23 +05:30
Abhinav Sarkar 7d64ffcde4 Adds incremental refresh sql generation for fact tables. 2015-12-20 18:25:14 +05:30
Abhinav Sarkar 7dc6db944f Adds incremental refresh sql generation for dimension tables.
- Adds partial unique indexes for tables to handle null columns.
- Adds validation for time column in fact tables.
2015-12-19 11:55:08 +05:30
Abhinav Sarkar e46d3684cd Fixes a typo. 2015-12-18 17:35:26 +05:30
Abhinav Sarkar 068190b520 Adds brew install command in setup instructions. 2015-12-18 17:12:13 +05:30
Abhinav Sarkar f8a6382aa3 Fixes bugs in fact table DDL and insert SQL generation. 2015-12-18 17:00:46 +05:30
Abhinav Sarkar 4a07d0c828 Adds setup instructions to the README. 2015-12-18 14:00:18 +05:30
Abhinav Sarkar c430e5f255 Refactoring. 2015-12-18 13:20:35 +05:30
Abhinav Sarkar a84325cb2a Makes the build work with stack lts-2. 2015-12-18 02:37:17 +05:30
Abhinav Sarkar ea9e100f8f Extracts constants in code to settings. 2015-12-18 01:33:06 +05:30
Abhinav Sarkar 21497269ee Adds index SQL in fact table create SQL. 2015-12-17 23:48:17 +05:30
Abhinav Sarkar c3d3019cd3 Adds SQL file generation to the executable 2015-12-17 23:18:12 +05:30
Abhinav Sarkar 4a5233a1a2 Adds the ability to run as an executable.
- Adds a parser to parse yaml file into tables and facts
- Adds program argument handling for specifying program settings
2015-12-17 20:02:13 +05:30
Abhinav Sarkar 900b4b7488 Adds fact table insert SQL generation. 2015-12-16 16:57:10 +05:30
Abhinav Sarkar c39916704e Refactoring 2015-12-16 03:14:04 +05:30
Abhinav Sarkar f016f0de09 Adds Tables file to gitignore 2015-12-16 02:20:26 +05:30
Abhinav Sarkar 041d55f9dd Refactors to move validation logic to its own namespace 2015-12-16 02:07:37 +05:30
Abhinav Sarkar 6e1341b52a Adds dimension table insert SQL generation.
Moves some private functions from Extractor to Extractor.Internal for reuse.
2015-12-15 18:22:51 +05:30
Abhinav Sarkar 6d8e32950f Adds SQL generation for table definitions.
And moves dimension and fact extraction logic to Ringo.Extractor namespace.
2015-12-15 17:22:45 +05:30
Abhinav Sarkar 3d00a89062 Changes to use Reader monad 2015-12-15 11:59:53 +05:30
Abhinav Sarkar b7d13c4947 Refactoring 2015-12-14 23:10:54 +05:30
Abhinav Sarkar 8e74c20705 Adds fact table extraction function 2015-12-14 21:57:11 +05:30
Abhinav Sarkar 9107b7c83d Adds validation and dimension extraction functions. 2015-12-10 20:30:55 +05:30