Skip to content
This repository was archived by the owner on Oct 4, 2019. It is now read-only.

Updating version #5

Open
wants to merge 380 commits into
base: development
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
380 commits
Select commit Hold shift + click to select a range
012a989
Bump version: 0.10.2a2 → 0.10.2a3
cmcarthur Jul 24, 2018
5d049b0
PR feedback
Jul 24, 2018
3cb174f
Handle weird windows clocks
Jul 25, 2018
c7c3d09
Merge pull request #877 from fishtown-analytics/add-generated-dates
beckjake Jul 25, 2018
38dc9fa
put "this" var back into operation context
drewbanin Jul 25, 2018
cea11a3
implement schema v2 support
Jul 19, 2018
ed22de1
Macros in the v2 schema now take column_name/model_name explicitly in…
Jul 23, 2018
b995cbb
Add/fix unit tests
Jul 24, 2018
a7ef822
Add schema.yml manifest changes to integration tests
Jul 25, 2018
e6b2179
fix for catlalog generation
drewbanin Jul 25, 2018
d6ee3ad
Add changelog entries (including retrospectively)
Jul 25, 2018
27d62b8
Make column tests optional
Jul 25, 2018
2e1d7c7
Add an issue template for dbt
Jul 25, 2018
975df13
first pass at a working "dbt docs serve" command!
cmcarthur Jul 25, 2018
6f01836
remove some unused imports
cmcarthur Jul 25, 2018
87d04ce
Merge branch 'development' of github.com:fishtown-analytics/dbt into …
cmcarthur Jul 25, 2018
ad78006
advise devs to not send usage stats
cmcarthur Jul 25, 2018
a2f8f48
Merge pull request #879 from fishtown-analytics/fix/readd-this-to-ope…
drewbanin Jul 25, 2018
1e513f3
pr feedback
Jul 25, 2018
42e611a
PR feedback
Jul 26, 2018
fdbf030
incorporate unique ids into catalog
cmcarthur Jul 26, 2018
e6550b4
More PR feedback
Jul 26, 2018
af42a20
warnings and errors
cmcarthur Jul 26, 2018
9ead266
finishing up
cmcarthur Jul 26, 2018
4cc8de9
Fix issues with for incremental models with unique keys, add hooks
drewbanin Jul 26, 2018
37c4279
More PR feedback, added a test around disabled models and tests
Jul 26, 2018
12d5c58
test existence of unique_id
cmcarthur Jul 26, 2018
44e06ee
add a contributing guide (#858)
cmcarthur Jul 26, 2018
fd3f9ef
fix for unicode error on py27
drewbanin Jul 26, 2018
5d0624b
Merge pull request #884 from fishtown-analytics/fix/bq-incremental-me…
drewbanin Jul 27, 2018
89001e1
Bump version: 0.10.2a3 → 0.10.2a4
cmcarthur Jul 30, 2018
2e1aaac
PR feedback
Jul 31, 2018
3b3a486
Merge pull request #880 from fishtown-analytics/new-schema-yaml-syntax
beckjake Jul 31, 2018
ec83c02
Merge pull request #881 from fishtown-analytics/issue-template
beckjake Jul 31, 2018
9404607
Merge branch 'development' into dev/isaac-asimov
Jul 31, 2018
c67924f
initial docs extension work
Jul 26, 2018
a4b6048
More work on docs blocks, added some rudimentary unit tests around pa…
Jul 26, 2018
1123f7e
attach the full docs block to ParsedDocumentation instead of the temp…
Jul 26, 2018
56b7aac
Add tests, wire up more things
Jul 30, 2018
f44a512
Add a test for late-binding views that has been hanging out on my fil…
Jul 31, 2018
4e57b17
Integration test -> many bug fixes
Jul 31, 2018
4a15f5e
(fixes #891) handle view <--> table materialization changes
drewbanin Aug 1, 2018
777510e
PR fixes, changelog update
Aug 1, 2018
c8d329e
Merge pull request #892 from fishtown-analytics/fix/relaton-type-swit…
drewbanin Aug 1, 2018
befe9c2
(fixes #890) Show more helpful error for misconfigured profile
drewbanin Aug 1, 2018
832f428
Merge pull request #893 from fishtown-analytics/fix/invalid-profile-e…
drewbanin Aug 1, 2018
73febed
Bump version: 0.10.2a4 → 0.10.2rc1
cmcarthur Aug 1, 2018
c60187f
Merge pull request #882 from fishtown-analytics/docs-serve
cmcarthur Aug 2, 2018
9767d11
Make a docs-paths, if unset it defaults to source-paths
Aug 2, 2018
1e98c54
updated index.html
cmcarthur Aug 2, 2018
4a9e3ee
Merge pull request #888 from fishtown-analytics/docs-blocks
beckjake Aug 2, 2018
37cd3e1
merged dev/isaac-asimov
cmcarthur Aug 2, 2018
1c2f6b6
Merge branch 'development' of github.com:fishtown-analytics/dbt
cmcarthur Aug 3, 2018
4136e96
Bump version: 0.10.2rc1 → 0.10.2
cmcarthur Aug 3, 2018
76f526d
Convert a lot from flat_graph -> manifest
Aug 1, 2018
5957195
Added a new contract set, moved manifest into that so we can allow bo…
Aug 2, 2018
2690b50
More flat_graph -> manifest conversion, fix issues caused by rebase
Aug 2, 2018
6d96981
pass the config through to context generator instead of a magic key i…
Aug 2, 2018
b5c2ce3
Made context take a ParsedNode instead of a dict. Added intentional s…
Aug 2, 2018
cad3f9a
unit tests pass again
Aug 2, 2018
2a11069
Make context generation accept ParsedMacros
Aug 3, 2018
b8aeb40
pep8
Aug 3, 2018
1df26d5
This is already a string...
Aug 3, 2018
d9001f8
PR feedback
Aug 3, 2018
1209212
contracts.graph.any -> contracts.graph.manifest
Aug 3, 2018
5fef752
This has to inherit from CompiledNode to get access to cte-related stuff
Aug 3, 2018
74b33f4
re-add check for extra ctes already being injected
Aug 3, 2018
10ceaa2
0.10.2 changelog
drewbanin Aug 3, 2018
b4480cb
Merge pull request #900 from fishtown-analytics/0-10-2-changelog
drewbanin Aug 3, 2018
bd79dd1
Merge pull request #899 from fishtown-analytics/goodbye-flat-graph
beckjake Aug 6, 2018
30f0369
Make the agate table type tester more restrictive on what counts as n…
jwerderits Aug 7, 2018
7c286fc
add a test
Aug 7, 2018
903612d
merged dev/isaac-asimov
cmcarthur Aug 8, 2018
ccd16a2
fix integration tests
cmcarthur Aug 8, 2018
ba6dca6
fix one test for redshift
cmcarthur Aug 8, 2018
e79904f
copy index file in generate task
cmcarthur Aug 8, 2018
ceb51df
fix index.html path
cmcarthur Aug 8, 2018
8256706
Change SOURCE and DEST aliases in BQ merge macro to DBT_INTERNAL_DEST…
lewish Aug 8, 2018
3cb27fb
Merge pull request #910 from fishtown-analytics/prep-sinter-docs
cmcarthur Aug 9, 2018
c815004
Merge pull request #883 from fishtown-analytics/incorporate-catalog-u…
cmcarthur Aug 9, 2018
77eb04a
updated index.html
cmcarthur Aug 9, 2018
57eaa0c
merged development
cmcarthur Aug 9, 2018
b801f9d
Make RunModelResult an APIObject with a contract, add write_json
Aug 6, 2018
4b43b6d
Add a JSONEncoder that encodes decimals to floats
Aug 6, 2018
9c9baf9
Integration tests
Aug 6, 2018
92566fd
Update changelog, I forgot as usual
Aug 7, 2018
5ccaf5b
make write_json just use write_file(...json.dumps())
Aug 8, 2018
4459c0d
Merge pull request #905 from fishtown-analytics/agate-less-aggressive…
beckjake Aug 9, 2018
b6f5283
Merge branch 'development' into write-run-results
beckjake Aug 9, 2018
b89018e
status can also be boolean now
Aug 9, 2018
02799e5
Merge pull request #904 from fishtown-analytics/write-run-results
beckjake Aug 10, 2018
6d5802c
(fixes #897) use dicts for columns in catalog and manifest
drewbanin Aug 9, 2018
e07a017
(fixes #896) use dict of unique ids for catalog nodes
drewbanin Aug 9, 2018
c4262a7
add tests for columns stored as dicts
drewbanin Aug 10, 2018
49373e5
Insert project metadata into the manifest
Aug 9, 2018
679e57c
Pass the full project object along to GraphLoader.load_all instead of…
Aug 9, 2018
34c113a
update unit tests
Aug 9, 2018
f58751b
integration tests
Aug 9, 2018
6e82e31
fix for bigquery test
drewbanin Aug 10, 2018
9cda84f
cache snowflake column defs in tests
drewbanin Jul 14, 2018
eaea480
handle column casing for snowflake
drewbanin Aug 12, 2018
1f2d9ca
Merge pull request #851 from fishtown-analytics/tests/snowflake-integ…
drewbanin Aug 13, 2018
ee1f385
Merge pull request #919 from fishtown-analytics/include-project-metadata
beckjake Aug 13, 2018
9bcd4e3
Merge pull request #917 from fishtown-analytics/feature/catalog-as-un…
drewbanin Aug 13, 2018
afb4658
bump docs site code to account for manifest + catalog changes
drewbanin Aug 13, 2018
825df51
Merge pull request #920 from fishtown-analytics/bump-docs-site
drewbanin Aug 13, 2018
f739bd3
Set google-cloud-bigquery dependency to >=1, <2
Aug 13, 2018
4b2332a
Quote schemas in snowflake__create_table_as
Aug 13, 2018
a57a487
Add a new test for explicitly lowercased snowflake schemas
Aug 13, 2018
545cf0b
Add version/type sanity checks in schema parsing
Aug 14, 2018
d1afb27
add a unit test
Aug 14, 2018
af59fd8
Pass column names through during schema parsing
Aug 14, 2018
7b70efe
add tests for column names in schemas
Aug 14, 2018
8428740
I don't know why, but this seems to fix the test?
Aug 14, 2018
cb285f5
enforce ordering on parent/child maps for test consistency
Aug 14, 2018
dd4f4c4
convert ctes to be stored in lists instead of ordered dicts
Aug 14, 2018
b71ff37
fix tests to expect lists of key/value dicts instead of dicts, add test
Aug 14, 2018
1d8b237
Merge pull request #923 from fishtown-analytics/upgrade-google-cloud-…
beckjake Aug 14, 2018
5a4bdd4
Merge pull request #925 from fishtown-analytics/quote-schema-in-temp-…
beckjake Aug 14, 2018
a698486
Merge pull request #929 from fishtown-analytics/fix-cte-ordering
beckjake Aug 15, 2018
cbc675e
pr feedback
Aug 15, 2018
e57c497
Add missing where clause
Aug 13, 2018
e752345
Add tests
Aug 13, 2018
8122c1b
I mixed up from and field pretty badly there
Aug 14, 2018
7baf983
fix tests, and make the table summary have a different name from its …
Aug 14, 2018
81e31e7
Convert relationships test to use left join instead of "not in"
Aug 14, 2018
f4cbf85
add some bigquery tests with ephemeral models
Aug 14, 2018
6222829
PR feedback
Aug 15, 2018
768abde
pr feedback
Aug 15, 2018
0a21938
remove config info from schema errors
Aug 15, 2018
fb25258
make our error/warning strings nicer for schema validation issues tha…
Aug 15, 2018
7029904
Merge branch 'nicer-validation-errors' into link-docs-on-parsing-failure
Aug 15, 2018
0e580ca
dbt docs generate now implicitly calls dbt compile, so all docs requi…
Aug 15, 2018
e2e2614
Merge pull request #921 from fishtown-analytics/relationships-tests-w…
beckjake Aug 15, 2018
5c062d6
On compile failure, return the compile results to generate better output
Aug 16, 2018
d528d25
add a test to ensure that --non-destructive doesn't break everything …
Aug 17, 2018
13cb504
Do not drop the view if we are not going to create a new one
Aug 17, 2018
7cd544d
Merge pull request #937 from fishtown-analytics/fix/non-destructive-a…
beckjake Aug 17, 2018
afe1489
Fix snowflake view swaps... and a lot of other things too
drewbanin Aug 17, 2018
dad9970
account for view --> table switch
drewbanin Aug 17, 2018
b33dbf0
fix tests
drewbanin Aug 17, 2018
457df4d
handle table --> view switch on snowflake
drewbanin Aug 20, 2018
f14ad85
pr feedback
Aug 21, 2018
e7ef99b
Merge pull request #926 from fishtown-analytics/link-docs-on-parsing-…
beckjake Aug 21, 2018
d050b32
Merge pull request #936 from fishtown-analytics/compile-on-docs-generate
beckjake Aug 21, 2018
afba7f7
Revert "call compile when generating docs (#932)"
beckjake Aug 21, 2018
bb5d211
Merge pull request #945 from fishtown-analytics/revert-936-compile-on…
beckjake Aug 21, 2018
02fc867
Revert "Merge pull request #945 from fishtown-analytics/revert-936-co…
Aug 21, 2018
19ccbf2
namespacing is hard
Aug 21, 2018
4881099
invert make_match_kwargs override, flip default snowflake quoting
Aug 20, 2018
b15c5a7
remove warning logging since we no longer do that
Aug 20, 2018
ebdc11b
Fix all the tests I broke
Aug 21, 2018
35333c5
make create/drop schema sql methods choose default quoting from the a…
Aug 21, 2018
6435c0f
numerous casing-related things on snowflake
Aug 21, 2018
1edfb50
another bigquery branch issue
Aug 21, 2018
7846a2e
snowflake is now unquoted, of course
Aug 22, 2018
90ea0e6
make this test actually run on snowflake, add a clamp because snowfla…
Aug 22, 2018
3868f70
more test cleanup post-merge
Aug 21, 2018
1a1d45c
Merge pull request #944 from fishtown-analytics/snowflake-default-unq…
beckjake Aug 22, 2018
9a395fa
Merge branch 'development' into compile-on-docs-generate
beckjake Aug 22, 2018
66fc74a
detailed catalog info
drewbanin Jul 24, 2018
090172c
pep8 + unit tests
Aug 17, 2018
f7c0b6f
make a canonical layout in integration tests
Aug 20, 2018
cd0263c
make postgres return something more similar to redshift
Aug 20, 2018
2a6277c
don't special-case has_stats, return a dict of dicts instead of list …
Aug 20, 2018
4b5417e
build out some bigquery stats
Aug 20, 2018
c027a12
add a description field for has_stats, for consistency
Aug 20, 2018
d4bdc50
bigquery fixes
Aug 20, 2018
0822af4
snowflake stats
Aug 20, 2018
88f3430
move has_stats to a python-computed value [skip ci]
Aug 20, 2018
5fe95db
fix redshift tests
Aug 20, 2018
eb9e4f7
snowflake tests
Aug 20, 2018
8570c63
fix unit tests
Aug 20, 2018
c9b1cad
make schema filtering case-insensitive
Aug 22, 2018
554ecb0
Only include table-only fields on bigquery if the relationship is a t…
Aug 22, 2018
7961300
pr feedback
drewbanin Aug 22, 2018
2d91be0
(fixes #941) Create default overview block for docs website
drewbanin Aug 21, 2018
9593a6f
fix tests
drewbanin Aug 22, 2018
dbb32e9
Merge branch 'development' into fix/snowflake-view-transactions
drewbanin Aug 23, 2018
6802237
Merge pull request #948 from fishtown-analytics/compile-on-docs-generate
beckjake Aug 23, 2018
bc23db0
Merge branch 'development' into detailed-catalog
Aug 23, 2018
06725c5
Merge branch 'development' into override-default-docs-for-website
cmcarthur Aug 23, 2018
ca42b63
Merge pull request #939 from fishtown-analytics/detailed-catalog
beckjake Aug 23, 2018
3601f1c
Merge branch 'development' into fix/snowflake-view-transactions
drewbanin Aug 23, 2018
287c4cf
Merge branch 'development' into override-default-docs-for-website
drewbanin Aug 23, 2018
435f1b4
Merge pull request #943 from fishtown-analytics/override-default-docs…
drewbanin Aug 23, 2018
78fd05a
Merge branch 'development' into fix/snowflake-view-transactions
drewbanin Aug 23, 2018
b1e186a
Merge pull request #940 from fishtown-analytics/fix/snowflake-view-tr…
drewbanin Aug 24, 2018
017e087
Merge branch 'development' into fix/merge_name_clashes
drewbanin Aug 24, 2018
72c39bc
Merge pull request #916 from lewish/fix/merge_name_clashes
drewbanin Aug 24, 2018
0e5a8f1
Remove unconditional calls to get_latest_version
Aug 24, 2018
045fccc
remove a sneaky, hidden unconditional call to get_latest_version
Aug 24, 2018
39cab15
Bump docs site index.html for column docs, custom overview
drewbanin Aug 24, 2018
088553d
Merge pull request #951 from fishtown-analytics/docs-site-0-11-a1-update
drewbanin Aug 24, 2018
8240542
Bump version: 0.10.2 → 0.11.0a1
cmcarthur Aug 24, 2018
96172da
initial work on a converter, only built-in tests handled
Aug 24, 2018
3b12b93
add handling for simple custom tests
Aug 24, 2018
9214e98
logging
Aug 24, 2018
c1c88a2
make the script run...
Aug 24, 2018
b99b4d5
format that log message
Aug 24, 2018
00fdf6a
control flow cleanup
Aug 27, 2018
1876257
add handling for unknown tests
Aug 27, 2018
15ca05d
add custom mappings arguments
Aug 27, 2018
01212cb
pep8/test sanity
Aug 27, 2018
4bb01e5
Merge branch 'development' into schema-v1-v2-converter
beckjake Aug 27, 2018
56957d4
Merge branch 'development' into selectively-download-bumpversion
beckjake Aug 27, 2018
9955070
make version special the same way argparse does, but with lazy evalua…
Aug 27, 2018
4ab0ec9
make the case of an inaccessible raw.githubusercontent.com a bit more…
Aug 27, 2018
383ea35
Convert the full project, not just single files
Aug 27, 2018
d946ac2
pep8
Aug 28, 2018
ed4b8f0
add handling for v1 schema.yml with a model named "version", and tests
Aug 28, 2018
9b15377
we set model_name in __init__, so just use that
Aug 28, 2018
dd406a8
add unit test
Aug 28, 2018
6060146
Merge pull request #949 from fishtown-analytics/selectively-download-…
beckjake Aug 28, 2018
50efa65
Merge branch 'development' into var-validate-model-name
beckjake Aug 28, 2018
6d6cb20
Merge pull request #958 from fishtown-analytics/var-validate-model-name
beckjake Aug 28, 2018
3046eee
Merge branch 'development' into handle-models-named-version
beckjake Aug 28, 2018
94c2b05
clean up the incorrect version message a bit
Aug 28, 2018
68047d6
Merge pull request #957 from fishtown-analytics/handle-models-named-v…
beckjake Aug 28, 2018
c38e34f
Merge branch 'development' into schema-v1-v2-converter
beckjake Aug 28, 2018
d56800f
set upper bound on boto3 version
drewbanin Aug 29, 2018
0fddcfe
turn off "flow style" in output
Aug 29, 2018
4d27585
Merge pull request #964 from fishtown-analytics/fix/snowflake-boto-ve…
drewbanin Aug 30, 2018
5c5f471
bump to 0.11.0a2
drewbanin Aug 30, 2018
78ca9d3
Merge pull request #967 from fishtown-analytics/bump/0.11.0a2
drewbanin Aug 30, 2018
fe2e22f
render injected (instead of compiled) sql in docs site
drewbanin Sep 4, 2018
5d4c770
Merge pull request #972 from fishtown-analytics/fix/show-injected-sql
drewbanin Sep 4, 2018
e0d87ee
get pyyaml to dump things in a more pleasing order
Sep 4, 2018
36cd333
if tests are not dicts, make them dicts
Sep 4, 2018
d24cf0a
this does not belong
Sep 4, 2018
4f4810c
Merge branch 'development' into schema-v1-v2-converter
beckjake Sep 4, 2018
7145fa5
Update CHANGELOG.md
drewbanin Sep 4, 2018
0f164c9
Merge pull request #952 from fishtown-analytics/schema-v1-v2-converter
beckjake Sep 4, 2018
d820d68
Bump version: 0.11.0a2 → 0.11.0rc1
cmcarthur Sep 4, 2018
6ef1ef6
pin botocore to the associated versions from boto3
cmcarthur Sep 5, 2018
75d6413
Bump version: 0.11.0rc1 → 0.11.0rc2
cmcarthur Sep 5, 2018
3a8ffa7
use initial dbt docs release
drewbanin Sep 5, 2018
386abbe
bump to 0.11.0
drewbanin Sep 5, 2018
ac16fef
Update CHANGELOG.md
drewbanin Sep 5, 2018
492305e
Update CHANGELOG.md
drewbanin Sep 5, 2018
025a872
Merge branch 'development' into 0.11.0-changelog
drewbanin Sep 5, 2018
f316b07
quick fix for invalid byte in Redshift stats response
drewbanin Sep 6, 2018
c358fc0
Merge branch '0.11.0-changelog' of github.com:fishtown-analytics/dbt …
drewbanin Sep 6, 2018
0d074c3
Merge pull request #974 from fishtown-analytics/0.11.0-changelog
drewbanin Sep 6, 2018
f143cfe
fix test
drewbanin Sep 6, 2018
6a62ec4
Merge pull request #977 from fishtown-analytics/fix/redshift-catalog-…
drewbanin Sep 7, 2018
4b39bad
Merge branch 'development' of https://github.com/fishtown-analytics/d…
ryantbrennan1 Sep 11, 2018
6b538aa
adding description
ryantbrennan1 Sep 11, 2018
669fa84
testing dateutil requirement
ryantbrennan1 Sep 11, 2018
77338e3
removing dateutil
ryantbrennan1 Sep 11, 2018
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
23 changes: 20 additions & 3 deletions .bumpversion.cfg
Original file line number Diff line number Diff line change
@@ -1,7 +1,24 @@
[bumpversion]
current_version = 0.10.0
commit = True
tag = True
current_version = 0.11.0
parse = (?P<major>\d+)
\.(?P<minor>\d+)
\.(?P<patch>\d+)
((?P<prerelease>[a-z]+)(?P<num>\d+))?
serialize =
{major}.{minor}.{patch}{prerelease}{num}
{major}.{minor}.{patch}
commit = False
tag = False

[bumpversion:part:prerelease]
first_value = a
values =
a
b
rc

[bumpversion:part:num]
first_value = 1

[bumpversion:file:setup.py]

Expand Down
141 changes: 141 additions & 0 deletions .circleci/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,141 @@
version: 2
jobs:
unit:
docker: &py36
- image: python:3.6
- image: postgres
environment: &pgenv
POSTGRES_USER: "root"
POSTGRES_PASSWORD: "password"
POSTGRES_DB: "dbt"
steps:
- checkout
- run: apt-get update && apt-get install -y python-dev python3-dev postgresql
- run: echo 127.0.0.1 database | tee -a /etc/hosts
- run: pip install virtualenvwrapper tox
- run: &setupdb
name: Setup postgres
command: bash test/setup_db.sh
environment:
PGHOST: 127.0.0.1
PGUSER: root
PGPASSWORD: password
PGDATABASE: postgres
- run: tox -e pep8,unit-py27,unit-py36
integration-postgres-py36:
docker: *py36
steps:
- checkout
- run: apt-get update && apt-get install -y python3-dev postgresql
- run: echo 127.0.0.1 database | tee -a /etc/hosts
- run: pip install virtualenvwrapper tox
- run: *setupdb
- run:
name: Run tests
command: tox -e integration-postgres-py36
integration-snowflake-py36:
docker: *py36
steps:
- checkout
- run: apt-get update && apt-get install -y python3-dev postgresql
- run: echo 127.0.0.1 database | tee -a /etc/hosts
- run: pip install virtualenvwrapper tox
- run:
name: Run tests
command: tox -e integration-snowflake-py36
no_output_timeout: 1h
integration-redshift-py36:
docker: *py36
steps:
- checkout
- run: apt-get update && apt-get install -y python3-dev postgresql
- run: echo 127.0.0.1 database | tee -a /etc/hosts
- run: pip install virtualenvwrapper tox
- run:
name: Run tests
command: tox -e integration-redshift-py36
integration-bigquery-py36:
docker: *py36
steps:
- checkout
- run: apt-get update && apt-get install -y python3-dev postgresql
- run: echo 127.0.0.1 database | tee -a /etc/hosts
- run: pip install virtualenvwrapper tox
- run:
name: Run tests
command: tox -e integration-bigquery-py36
integration-postgres-py27:
docker: &py27
- image: python:2.7
- image: postgres
environment: *pgenv
steps:
- checkout
- run: apt-get update && apt-get install -y python-dev postgresql
- run: echo 127.0.0.1 database | tee -a /etc/hosts
- run: pip install virtualenvwrapper tox
- run: *setupdb
- run:
name: Run tests
command: tox -e integration-postgres-py27
integration-snowflake-py27:
docker: *py27
steps:
- checkout
- run: apt-get update && apt-get install -y python-dev postgresql
- run: echo 127.0.0.1 database | tee -a /etc/hosts
- run: pip install virtualenvwrapper tox
- run:
name: Run tests
command: tox -e integration-snowflake-py27
no_output_timeout: 1h
integration-redshift-py27:
docker: *py27
steps:
- checkout
- run: apt-get update && apt-get install -y python-dev postgresql
- run: echo 127.0.0.1 database | tee -a /etc/hosts
- run: pip install virtualenvwrapper tox
- run:
name: Run tests
command: tox -e integration-redshift-py27
integration-bigquery-py27:
docker: *py27
steps:
- checkout
- run: apt-get update && apt-get install -y python-dev postgresql
- run: echo 127.0.0.1 database | tee -a /etc/hosts
- run: pip install virtualenvwrapper tox
- run:
name: Run tests
command: tox -e integration-bigquery-py27

workflows:
version: 2
test-everything:
jobs:
- unit
- integration-postgres-py36:
requires:
- unit
- integration-postgres-py27:
requires:
- unit
- integration-redshift-py27:
requires:
- integration-postgres-py27
- integration-bigquery-py27:
requires:
- integration-postgres-py27
- integration-snowflake-py27:
requires:
- integration-postgres-py27
- integration-redshift-py36:
requires:
- integration-postgres-py36
- integration-bigquery-py36:
requires:
- integration-postgres-py36
- integration-snowflake-py36:
requires:
- integration-postgres-py36
34 changes: 34 additions & 0 deletions .github/ISSUE_TEMPLATE.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
Please make sure to fill out either the issue template or the feature template and delete the other one!

## Issue

### Issue description
In general terms, please describe the issue. What command did you run?

### Results
What happened? What did you expect to happen?

### System information
The output of `dbt --version`:
```
<output goes here>
```

The operating system you're running on:

The python version you're using (probably the output of `python --version`)

### Steps to reproduce
In as much detail as possible, please provide steps to reproduce the issue. Sample data that triggers the issue, example models, etc are all very helpful here.





## Feature

### Feature description
Please describe the feature you would like dbt to have. Please provide any details, relevant documentation links, StackOverflow links, etc here.

### Who will this benefit?
What kind of use case will this feature be useful for? Please be specific and provide examples, this will help us prioritize properly.
5 changes: 5 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -65,3 +65,8 @@ target/

#Emacs
*~

# Sublime Text
*.sublime-*

.python-version
123 changes: 123 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,126 @@
## dbt 0.11.0 - Isaac Asimov (September 6, 2018)

### Overview

This release adds support for auto-generated dbt documentation, adds a new syntax for `schema.yml` files, and fixes a number of minor bugs. With the exception of planned changes to Snowflake's default quoting strategy, this release should not contain any breaking changes. Check out the [blog post](https://blog.fishtownanalytics.com/using-dbt-docs-fae6137da3c3) for more information about this release.

### Breaking Changes
- Change default Snowflake quoting strategy to "unquoted" ([docs](https://docs.getdbt.com/v0.11/docs/configuring-quoting)) ([#824](https://github.com/fishtown-analytics/dbt/issues/824))

### Features

- Add autogenerated dbt project documentation ([docs](https://docs.getdbt.com/v0.11/docs/testing-and-documentation)) ([#375](https://github.com/fishtown-analytics/dbt/issues/375), [#863](https://github.com/fishtown-analytics/dbt/issues/863), [#941](https://github.com/fishtown-analytics/dbt/issues/941), [#815](https://github.com/fishtown-analytics/dbt/issues/815))
- Version 2 of schema.yml, which allows users to create table and column comments that end up in the manifest ([docs](https://docs.getdbt.com/v0.11/docs/schemayml-files)) ([#880](https://github.com/fishtown-analytics/dbt/pull/880))
- Extend catalog and manifest to also support Snowflake, BigQuery, and Redshift, in addition to existing Postgres support ([#866](https://github.com/fishtown-analytics/dbt/pull/866), [#857](https://github.com/fishtown-analytics/dbt/pull/857), [#849](https://github.com/fishtown-analytics/dbt/pull/849))
- Add a 'generated_at' field to both the manifest and the catalog. ([#887](https://github.com/fishtown-analytics/dbt/pull/877))
- Add `docs` blocks that users can put into `.md` files and `doc()` value for schema v2 description fields ([#888](https://github.com/fishtown-analytics/dbt/pull/888))
- Write out a 'run_results.json' after dbt invocations. ([#904](https://github.com/fishtown-analytics/dbt/pull/904))
- Type inference for interpreting CSV data is now less aggressive ([#905](https://github.com/fishtown-analytics/dbt/pull/905))
- Remove distinction between `this.table` and `this.schema` by refactoring materialization SQL ([#940](https://github.com/fishtown-analytics/dbt/pull/940))

### Fixes
- Fix for identifier clashes in BigQuery merge statements ([#914](https://github.com/fishtown-analytics/dbt/issues/914))
- Fix for unneccessary downloads of `bumpversion.cfg`, handle failures gracefully ([#907](https://github.com/fishtown-analytics/dbt/issues/907))
- Fix for incompatible `boto3` requirements ([#959](https://github.com/fishtown-analytics/dbt/issues/959))
- Fix for invalid `relationships` test when the parent column contains null values ([#921](https://github.com/fishtown-analytics/dbt/pull/921))

### Contributors

Thanks for contributing!

- [@rsmichaeldunn](https://github.com/rsmichaeldunn) ([#799](https://github.com/fishtown-analytics/dbt/pull/799))
- [@lewish](https://github.com/fishtown-analytics/dbt/pull/915) ([#915](https://github.com/fishtown-analytics/dbt/pull/915))
- [@MartinLue](https://github.com/MartinLue) ([#872](https://github.com/fishtown-analytics/dbt/pull/872))

## dbt 0.10.2 - Betsy Ross (August 3, 2018)

### Overview

This release makes it possible to alias relation names, rounds out support for BigQuery with incremental, archival, and hook support, adds the IAM Auth method for Redshift, and builds the foundation for autogenerated dbt project documentation, to come in the next release.

Additionally, a number of bugs have been fixed including intermittent BigQuery 404 errors, Redshift "table dropped by concurrent query" errors, and a probable fix for Redshift connection timeout issues.

### Contributors

We want to extend a big thank you to our outside contributors for this release! You all are amazing.

- [@danielchalef](https://github.com/danielchalef) ([#818](https://github.com/fishtown-analytics/dbt/pull/818))
- [@mjumbewu](https://github.com/mjumbewu) ([#796](https://github.com/fishtown-analytics/dbt/pull/796))
- [@abelsonlive](https://github.com/abelsonlive) ([#800](https://github.com/fishtown-analytics/dbt/pull/800))
- [@jon-rtr](https://github.com/jon-rtr) ([#800](https://github.com/fishtown-analytics/dbt/pull/800))
- [@mturzanska](https://github.com/mturzanska) ([#797](https://github.com/fishtown-analytics/dbt/pull/797))
- [@cpdean](https://github.com/cpdean) ([#780](https://github.com/fishtown-analytics/dbt/pull/780))

### Features

- BigQuery
- Support incremental models ([#856](https://github.com/fishtown-analytics/dbt/pull/856)) ([docs](https://docs.getdbt.com/docs/configuring-models#section-configuring-incremental-models))
- Support archival ([#856](https://github.com/fishtown-analytics/dbt/pull/856)) ([docs](https://docs.getdbt.com/docs/archival))
- Add pre/post hook support ([#836](https://github.com/fishtown-analytics/dbt/pull/836)) ([docs](https://docs.getdbt.com/docs/using-hooks))
- Redshift: IAM Auth ([#818](https://github.com/fishtown-analytics/dbt/pull/818)) ([docs](https://docs.getdbt.com/docs/supported-databases#section-iam-authentication))
- Model aliases ([#800](https://github.com/fishtown-analytics/dbt/pull/800))([docs](https://docs.getdbt.com/docs/using-custom-aliases))
- Write JSON manifest file to disk during compilation ([#761](https://github.com/fishtown-analytics/dbt/pull/761))
- Add forward and backward graph edges to the JSON manifest file ([#762](https://github.com/fishtown-analytics/dbt/pull/762))
- Add a 'dbt docs generate' command to generate a JSON catalog file ([#774](https://github.com/fishtown-analytics/dbt/pull/774), [#808](https://github.com/fishtown-analytics/dbt/pull/808))

### Bugfixes

- BigQuery: fix concurrent relation loads ([#835](https://github.com/fishtown-analytics/dbt/pull/835))
- BigQuery: support external relations ([#828](https://github.com/fishtown-analytics/dbt/pull/828))
- Redshift: set TCP keepalive on connections ([#826](https://github.com/fishtown-analytics/dbt/pull/826))
- Redshift: fix "table dropped by concurrent query" ([#825](https://github.com/fishtown-analytics/dbt/pull/825))
- Fix the error handling for profiles.yml validation ([#820](https://github.com/fishtown-analytics/dbt/pull/820))
- Make the `--threads` parameter actually change the number of threads used ([#819](https://github.com/fishtown-analytics/dbt/pull/819))
- Ensure that numeric precision of a column is not `None` ([#796](https://github.com/fishtown-analytics/dbt/pull/796))
- Allow for more complex version comparison ([#797](https://github.com/fishtown-analytics/dbt/pull/797))

### Changes

- Use a subselect instead of CTE when building incremental models ([#787](https://github.com/fishtown-analytics/dbt/pull/787))
- Internals
- Improved dependency selection, rip out some unused dependencies ([#848](https://github.com/fishtown-analytics/dbt/pull/848))
- Stop tracking `run_error` in tracking code ([#817](https://github.com/fishtown-analytics/dbt/pull/817))
- Use Mapping instead of dict as the base class for APIObject ([#756](https://github.com/fishtown-analytics/dbt/pull/756))
- Split out parsers ([#809](https://github.com/fishtown-analytics/dbt/pull/809))
- Fix `__all__` parameter in submodules ([#780](https://github.com/fishtown-analytics/dbt/pull/780))
- Switch to CircleCI 2.0 ([#843](https://github.com/fishtown-analytics/dbt/pull/843), [#850](https://github.com/fishtown-analytics/dbt/pull/850))
- Added tox environments that have the user specify what tests should be run ([#837](https://github.com/fishtown-analytics/dbt/pull/837))

## dbt 0.10.1 (May 18, 2018)

This release focuses on achieving functional parity between all of dbt's adapters. With this release, most dbt functionality should work on every adapter except where noted [here](https://docs.getdbt.com/v0.10/docs/supported-databases#section-caveats).

### tl;dr
- Configure model schema and name quoting in your `dbt_project.yml` file ([Docs](https://docs.getdbt.com/v0.10/docs/configuring-quoting))
- Add a `Relation` object to the context to simplify model quoting [Docs](https://docs.getdbt.com/v0.10/reference#relation)
- Implement BigQuery materializations using new `create table as (...)` syntax, support `partition by` clause ([Docs](https://docs.getdbt.com/v0.10/docs/warehouse-specific-configurations#section-partition-clause))
- Override seed column types ([Docs](https://docs.getdbt.com/v0.10/reference#section-override-column-types))
- Add `get_columns_in_table` context function for BigQuery ([Docs](https://docs.getdbt.com/v0.10/reference#get_columns_in_table))

### Changes
- Consistent schema and identifier quoting ([#727](https://github.com/fishtown-analytics/dbt/pull/727))
- Configure quoting settings in the `dbt_project.yml` file ([#742](https://github.com/fishtown-analytics/dbt/pull/742))
- Add a `Relation` object to the context to make quoting consistent and simple ([#742](https://github.com/fishtown-analytics/dbt/pull/742))
- Use the new `create table as (...)` syntax on BigQuery ([#717](https://github.com/fishtown-analytics/dbt/pull/717))
- Support `partition by` clause
- CSV Updates:
- Use floating point as default seed column type to avoid issues with type inference ([#694](https://github.com/fishtown-analytics/dbt/pull/694))
- Provide a mechanism for overriding seed column types in the `dbt_project.yml` file ([#708](https://github.com/fishtown-analytics/dbt/pull/708))
- Fix seeding for files with more than 16k rows on Snowflake ([#694](https://github.com/fishtown-analytics/dbt/pull/694))
- Implement seeds using a materialization
- Improve `get_columns_in_table` context function ([#709](https://github.com/fishtown-analytics/dbt/pull/709))
- Support numeric types on Redshift, Postgres
- Support BigQuery (including nested columns in `struct` types)
- Support cross-database `information_schema` queries for Snowflake
- Retain column ordinal positions

### Bugfixes
- Fix for incorrect var precendence when using `--vars` on the CLI ([#739](https://github.com/fishtown-analytics/dbt/pull/739))
- Fix for closed connections in `on-run-end` hooks for long-running dbt invocations ([#693](https://github.com/fishtown-analytics/dbt/pull/693))
- Fix: don't try to run empty hooks ([#620](https://github.com/fishtown-analytics/dbt/issues/620), [#693](https://github.com/fishtown-analytics/dbt/pull/693))
- Fix: Prevent seed data from being serialized into `graph.gpickle` file ([#720](https://github.com/fishtown-analytics/dbt/pull/720))
- Fix: Disallow seed and model files with the same name ([#737](https://github.com/fishtown-analytics/dbt/pull/737))

## dbt 0.10.0 (March 8, 2018)

This release overhauls dbt's package management functionality, makes seeding csv files work across all adapters, and adds date partitioning support for BigQuery.
Expand Down
Loading