Instructions on how to run

[jhaines1989]

Hi Peter ,

This might be a silly question and I apologize in advance.

Is there any instruction on how I actually run this and what OS it needs to be run on ?

[peterM]

Hi Jordan
The tool is mainly for Windows (10) OS.

You can run executable from console or install it as Windows service.
How to use:

• Download release zip file.
• Unpack zip file somewhere
• Open and update config file 'MalikP.Ubiquiti.DatabaseExporter.Service.exe.config' to fit your environment - check readme
• Create destination folder for files,
• Create database for exported data and create schema from script
• Run Console (WIN+R and enter CMD)
• Navigate to path where tool is extracted
• run 'MalikP.Ubiquiti.DatabaseExporter.Service.exe'
• data should be extracted to target folder (depending from configuration) & data should be written to database (depending from configuration)

[jhaines1989]

Thanks for the info.
I can't seem to find any files that end in service.exe in the .zip I downloaded.
There is an app.config that I have found that seems to have the parameters mentioned in the readme.

Now all I need know which file will execute the program and I don't have one called "MalikP.Ubiquiti.DatabaseExporter.Service.exe"

[peterM]

Did you download zip file from here ?

[jhaines1989]

Ah I was clearly downloading the source code !

Thanks for your help and sorry for bothering you with something so simple.

[peterM]

No problem. I hope it will work well also in your environment..

[peterM]

@abzkebabs Could you provide me some feedback ?
like:

• did it work in your environment ?
• how do you like it ?
• is it helpfull ?
  Thanks.

[jhaines1989]

Hi Peter ,

I did give it a go and the CMD prompt just stayed on all day with out any data being written to my file location.
I was just trying to do a dump to file as a test first before moving to SQL and the config had no SQL connection configured in it.

any ideas on why it would just hang and not do anything ? I was running it on Server 2016 FYI.

Was planning on coming back to have another go soon when I have some spare time at work.

Thanks

[peterM]

Could you send me your config file (without passwords) to p.malik@malikp.eu and also attach some information about your controller ?

Is it CloudKey or Windows based controller ?

or try this (valid in case you are using cloudkey):

<?xml version="1.0" encoding="utf-8"?>
<configuration>
	<startup>
		<supportedRuntime version="v4.0" sku=".NETFramework,Version=v4.7.2" />
	</startup>
	<appSettings>
		<add key="Use-Encrypted-Psswords" value="false"/>

		<!-- certificate have to be in certification store local machine -->
		<add key="Encryption-Certificate-Identifier" value="[Encryption-Certificate-Serial-Number]" />

		<add key="Backup-Path" value="C:\UnifiBackup" />
		<add key="Mongo-Connection-String" value="mongodb://127.0.0.1:27117" />

		<!-- Everytim turn off pooling by `Pooling=false;` -->
		<add key="Sql-Connection-String" value="Server=[Server];Database=Ubiquiti-Unifi-Backup;Pooling=false;" />
		<add key="Sql-User-Id" value="" />

		<!-- password encrypted by certificate -->
		<add key="Sql-User-Password" value="" />

		<!-- have to be greater than 0-->
		<add key="Sql-Batch-Size" value="100"/>

		<add key="Export-To-FS" value="true" />
		<add key="Export-To-DB" value="false" />

		<!-- 
			use ssl tunel when you want extract data from cloud key 
			in case you want to extract data from windows based controller set 'Use-SSH-Tunel' to 'False'
		-->
		<add key="Use-SSH-Tunel" value="true" />
		<add key="SSH-Tunel-Host" value="IP-OF-UNIFI-CONTROLLER" />
		<add key="SSH-Tunel-UserName" value="admin" />

		<!-- password encrypted by certificate -->
		<add key="SSH-Tunel-Password" value="YOUR-PASSWORD" />
		<add key="SSH-Forward-Host-From" value="127.0.0.1" />
		<add key="SSH-Forward-Port-From" value="27117" />
		<add key="SSH-Forward-Host-To" value="127.0.0.1" />
		<add key="SSH-Forward-Port-To" value="27117" />

		<add key="Blacklisted-Table-Names" value=""/>

	</appSettings>
	<runtime>
		<assemblyBinding xmlns="urn:schemas-microsoft-com:asm.v1">
			<dependentAssembly>
				<assemblyIdentity name="System.Buffers" publicKeyToken="cc7b13ffcd2ddd51" culture="neutral" />
				<bindingRedirect oldVersion="0.0.0.0-4.0.2.0" newVersion="4.0.2.0" />
			</dependentAssembly>
		</assemblyBinding>
	</runtime>
</configuration>

and do not forget change key:

<add key="SSH-Tunel-Host" value="IP-OF-UNIFI-CONTROLLER" />

and key :

<add key="SSH-Tunel-Password" value="YOUR-PASSWORD" />

[juanpmox]

Hello Peter, in first place, thanks for this awsome utility!

I'm using it on my network, and dumping data from CloudKey to file system is going wel.

I have problems when try to dump data to sql. I'm using a configuration based on the settings you suggest on Sept 17, 2018

The SQL related lines, are

---

	<!-- Everytim turn off pooling by `Pooling=false;` -->
	<add key="Sql-Connection-String" value="Server=MYSERVER;Database=Ubiquiti-Unifi-Backup;Pooling=true;" />
	<add key="Sql-User-Id" value="user-sql-login" />

	<!-- password encrypted by certificate -->
	<add key="Sql-User-Password" value="user-sql-password" />

---

Monitoring the process, I've found that none connections are made from the MalikP.Ubiquiti.DatabaseExporter.Service.exe to the SQL Server.

Am I missing some configuration or pre-req installation?

Thank you some much, in advance.
Best regards.

[peterM]

Hi @juanpmox

Please try these steps.:

• create empty database (best is to use this name Ubiquiti-Unifi-Backup)
  • or you can use script 1. Create_db_script.sql in install folder https://github.com/peterM/Ubiquiti-Unifi-Data-Exporter/tree/master/install
• execute script 2. Create_schema.sql also from https://github.com/peterM/Ubiquiti-Unifi-Data-Exporter/tree/master/install
• use this new db in your ConnectionString

please let me know if it helped or not

[juanpmox]

Unfortunately, same result :(

• DB Ubiquiti-Unifi-Backup, created with script
• DB schema, created, with the script too

Ran the tool again, from Windows cmd.exe, but none data is imported to DB

[peterM]

Hmm .... 🤔
I have several questions:

• Did you try run it as administrator ?
• Did you run from command prompt / console or as windows service ?
• did you allow export to db ? <add key="Export-To-DB" value="true"/>
• could you send me your config (anonymized)

[juanpmox]

my comments below:
Did you try run it as administrator ? => Yes
Did you run from command prompt / console or as windows service ? => Yes, form console, and with scheduled task
did you allow export to db ? => Yes
could you send me your config (anonymized) => Yes, I'll sending you the config file to p.malik@malikp.eu