@@ -131,3 +131,68 @@ Looking at the directory structure and the config files, they could look as foll
131
131
With log level set to VERBOSE set in the config file, output might look like this:
132
132
133
133
![ Running Butler Spyglass] ( img/running-butler-spyglass-1.png " With verbose logging level, information about individual apps is shown. ")
134
+
135
+ ## Output files
136
+
137
+ The data lineage information is saved to a single ``` lineage.csv ``` file:
138
+
139
+ AppId,Discriminator,Statement
140
+ 10793a99-ef94-46ad-ae33-6a9efd260ab3,DSN=AUTOGENERATE;,
141
+ b7ef5bff-5a13-4d61-bae4-45b5fab722f9,RESIDENT RestConnectorMasterTable;,
142
+ 916234f2-ffdb-4506-9c5b-193063da05ab,DSN=AUTOGENERATE;,
143
+ 916234f2-ffdb-4506-9c5b-193063da05ab,DSN=https://bolin.su.se/data/stockholm/files/stockholm-historical-weather-observations-ver-1.0.2016/temperature/daily/raw/stockholma_daily_temp_obs_2013_2016_t1t2t3txtntm.txt;,
144
+ 65c7ea3e-242d-423f-aa01-8acd24e4a7ed,DSN=AUTOGENERATE;,
145
+ 8bd92672-8cf4-446e-8f5e-8c77205eefc3,DSN=AUTOGENERATE;,
146
+ 0b94c6f9-82ce-40f1-a38c-8d277b01498e,RESIDENT RestConnectorMasterTable;,
147
+ 0b94c6f9-82ce-40f1-a38c-8d277b01498e,{STORE - [Lib://App metadata/app_dump/20190125_apps.qvd] (qvd)};,
148
+ 0b94c6f9-82ce-40f1-a38c-8d277b01498e,{STORE - [Lib://App metadata/app_dump/current_apps.qvd] (qvd)};,
149
+ 0b94c6f9-82ce-40f1-a38c-8d277b01498e,monitor_apps_REST_app;,"RestConnectorMasterTable:
150
+ SQL SELECT
151
+ ""id"" ,
152
+ ""name"",
153
+ ""__KEY_root""
154
+ FROM JSON (wrap on) ""root"" PK ""__KEY_root"""
155
+ ,,
156
+ 62dc4e60-8ba6-48af-9eac-9a076fd35819,DSN=AUTOGENERATE;,
157
+
158
+ Each app's load script is stored as its own file, with the app ID as the file name:
159
+
160
+ ➜ ll out/script
161
+ total 2024
162
+ -rw-r--r-- 1 goran staff 12K Mar 10 17:46 0325381f-0a6f-4dda-a89b-0fc125e1eeee.qvs
163
+ -rw-r--r-- 1 goran staff 819B Mar 10 17:46 03941343-21d9-4e43-98db-26c87e381b69.qvs
164
+ -rw-r--r-- 1 goran staff 11K Mar 10 17:46 0581fa58-34f5-4f79-a4c2-85c4e2d6e367.qvs
165
+ -rw-r--r-- 1 goran staff 483B Mar 10 17:46 05f21ae5-7877-4ce4-b65e-1160ac3deaea.qvs
166
+ -rw-r--r-- 1 goran staff 5.2K Mar 10 17:46 084b62fb-69ab-49c0-8170-203170b81b9e.qvs
167
+
168
+
169
+
170
+ ➜ cat out/script/03941343-21d9-4e43-98db-26c87e381b69.qvs
171
+ ///$tab Main
172
+ SET ThousandSep=',';
173
+ SET DecimalSep='.';
174
+ SET MoneyThousandSep=',';
175
+ SET MoneyDecimalSep='.';
176
+ SET MoneyFormat='$#,##0.00;-$#,##0.00';
177
+ SET TimeFormat='h:mm:ss TT';
178
+ SET DateFormat='M/D/YYYY';
179
+ SET TimestampFormat='M/D/YYYY h:mm:ss[.fff] TT';
180
+ SET FirstWeekDay=6;
181
+ SET BrokenWeeks=1;
182
+ SET ReferenceDay=0;
183
+ SET FirstMonthOfYear=1;
184
+ SET CollationLocale='en-US';
185
+ SET CreateSearchIndexOnReload=1;
186
+ SET MonthNames='Jan;Feb;Mar;Apr;May;Jun;Jul;Aug;Sep;Oct;Nov;Dec';
187
+ SET LongMonthNames='January;February;March;April;May;June;July;August;September;October;November;December';
188
+ SET DayNames='Mon;Tue;Wed;Thu;Fri;Sat;Sun';
189
+ SET LongDayNames='Monday;Tuesday;Wednesday;Thursday;Friday;Saturday;Sunday';
190
+
191
+ ///$tab Section
192
+ Sleep 10000;
193
+ ///$tab Auto-generated section
194
+ ///$autogenerated
195
+
196
+
197
+ Unqualify *;
198
+
0 commit comments