Commit Graph

33 Commits

Author SHA1 Message Date
Kenneth Skovhede 49fb45859c Fixed some incorrectly quoted literals in SQL statements 2024-04-15 08:24:01 +02:00
tariandeath d44496f6d4 Add semicolons 2022-02-27 13:29:58 -07:00
JED 662bad4526 Add newline 2022-02-27 00:13:37 -07:00
tariandeath 396119aa40 Add indexes to improve backup query performance. 2022-02-26 20:24:14 -07:00
Kenneth Skovhede 9eef0a92f7 Updated the schema to include DB version 11 changes. 2020-05-10 21:30:15 +02:00
Kenneth Hsu 6638af10e7 Add indices to Block table to improve query performance.
The index on Block.Size improves the performance of the query that
checks that the user has not altered the block size of the backup
configuration.

The index on Block.Hash and Block.VolumeID improves the performance of
the query that obtains the blocklists.

There are anecdotes that these indices can drastically improve
performance (queries that used to take hours completed in seconds with
the index):

https://forum.duplicati.com/t/repairing-a-big-database/8174/4
https://github.com/duplicati/duplicati/issues/3884#issuecomment-612296016

This fixes issue #3884.
2020-04-11 11:47:40 -07:00
BlueBlock cc0b0472dc codacy is very particular with sql
codacy uses sqlint so formatting looks to be inportant or an error is found.
Format the SQL using sqlint or a tool that uses sqlint such as https://www.onlinegdb.com/online_sqlite_editor and run Beautify.
2019-08-28 15:00:02 -04:00
BlueBlock 226cd337ff modify db update 10 to conform to structure of others db updates 2019-08-16 00:26:52 -04:00
BlueBlock 08e2c18185 add handling of a partial backup
- add backup state to DB table 'fileset' (job database upgrade to version 10)
- modify the Restore page dropdown to display if a backup is "partial"
- modify retention logic to remove partial backups only when the next recent full-backup has been removed
2019-08-05 20:14:05 -04:00
Kenneth Skovhede 8b3dfcace8 Fixed the database upgrade script to copy over file IDs to avoid breaking databases on upgrade 2019-01-30 11:03:44 +01:00
Kenneth Skovhede 69cc889eb2 Fixed creating the USN table on a clean database 2018-06-14 10:56:15 +02:00
Kenneth Skovhede cbc18970d5 Re-applied the path-storage fix as the merge failed somehow 2018-06-14 10:12:24 +02:00
Daniel Gehriger 7bf0a25912 Revert "Merge remote-tracking branch 'upstream/feature/fix_path_storage' into feature/usn"
This reverts commit 10d6b4c31c, reversing
changes made to 1af7f9e0ca.
2018-04-23 23:02:52 +02:00
Daniel Gehriger 10d6b4c31c Merge remote-tracking branch 'upstream/feature/fix_path_storage' into feature/usn 2018-04-23 22:57:32 +02:00
Kenneth Skovhede a8a32ea115 Added refactoring to improve the storage requirements for the local database, and speed up various queries.
This fixes #1283
2018-04-23 22:31:47 +02:00
Daniel Gehriger 2c1a0ddb4e Implemented backup based on changes recorded in NTFS USN journal 2018-04-19 22:59:28 +02:00
Kenneth Skovhede c5de213635 Added the unique constraint.
This fixes #2302
This fixes #2537
2017-06-15 10:07:58 +02:00
Carlo "zED" Caputo 3e0447f342 Faster database recreation 2017-04-11 16:20:42 -03:00
FootStark 568cc60856 Fixed lookup of a file's last entry during backup
- Fixed SQL to create temp table for lookup of last backup's file
entries
- Removed temp table by writing directly to internal lookup struct.
- Direct lookup of single file entries from DB
2016-05-06 00:14:03 +02:00
FootStark 7656e891ce Prepocessor for schema, Optimized RemoveRemoteVolume
Added a preprocessor for schema supporting sqlite_version-dependent
Statements
RemoveRemoteVolume deletes volumes in batch.
2016-03-16 00:49:28 +01:00
FootStark f0525d8ed5 Improved DB schema (version 5) for BlockSetEntry 2016-03-14 23:35:54 +01:00
FootStark 5320a0af13 Mitigate slow vol-deletion by caching slow subquery. 2016-03-13 13:23:06 +01:00
Kenneth Skovhede 50743b06ed Implemented indexes as suggested in #1481 and #1391 2015-11-16 12:57:34 +01:00
Kenneth Skovhede 0de9adc606 Added grace-period for incomplete uploads to avoid backups stopping due to the Apache WebDAV issues.
This fixes #1243.
2015-04-05 14:33:13 +02:00
Kenneth Skovhede 4846ffa103 Now using the file modification timestamp and the filesize as indicators that trigger file scanning.
This fixes #1099.
2015-01-24 21:59:53 +01:00
Kenneth Skovhede 5dfa207886 Bugfix 2014-11-23 21:53:33 +01:00
Kenneth Skovhede cc4c320ec0 Fixed a syntax error. 2014-10-31 18:27:12 +01:00
Kenneth Skovhede d05f6f1324 Improved performance when running with all in-memory caches disabled by a factor of 16.
On a smaller dataset, the performance is now only a little more than twice as slow with a low memory footprint compared to the default with all memory caches enabled.
2014-10-30 23:45:36 +01:00
Kenneth Skovhede 7e1ea91760 Added rolling checks to ensure equal testing of all files. 2013-07-30 22:42:59 +02:00
Kenneth Skovhede f0f465160f Changed the remaining DateTime columns to epoch seconds 2013-07-24 17:21:38 +02:00
Kenneth Skovhede 5c110162ea Changed the time format of times used programmatically to use EPOCH seconds, as it is faster to parse and more reliable 2013-07-23 21:28:01 +02:00
Kenneth Skovhede a1ef4dbe96 Rewrote the way the database is recreated to ensure greater stability when recovering from a damaged backup.
The restore now correctly works with missing index files and full index files.
2013-07-22 16:54:19 +02:00
Kenneth Skovhede 8f704d9445 Moved stuff around and dropped the ForestHash namespace 2013-05-08 20:17:07 +02:00