Copyright 2020-2025, Circumtec
Dataparse 5.x
Version: 5.0.5
Release Date: 24/06/2025
Upgraded vmmscore from 0.0.11 to 0.0.12.
Updated the packaged vmmscore jar used by the project.
Refreshed release version information for the 5.0.5 build.
Version: 5.0.4
Release Date: 01/05/2025
Introduced AwsSqsConsumerTask.
Version: 5.0.3
Release Date: 20/02/2025
Implemented the Forward feature by using a thread pool.
Version: 5.0.2
Release Date: 17/02/2025
Changed restockManager to use SQS instead of HTTP.
SQS queue name now follows the pattern restock_manager_.fifo, for example restock_manager_vmms.fifo.
Version: 5.0.1
Release Date: 28/11/2024
Upgraded to the MariaDB JDBC driver that supports both MySQL 8 and MySQL 5.6.
Migrated the build and release process to Gradle.
AWS Lambda release now uses deploy.sh.
Upgraded runtime to JDK 17 and Tomcat 9.
Version: 5.0.0
Release Date: 15/11/2024
First release of Dataparse 5.x.
Dataparse 4.x
Version: 4.42
Release Date: 21/10/2024
Ignored the leading CA1* when parsing records such as CA1CA2157681051660*0.
Version: 4.41
Release Date: 10/10/2024
Increased the serial number length of CA101 coin mech to 50.
Version: 4.40
Release Date: 06/05/2024
When a DTU report can be matched to a machine, saving the machine's last report now also sets the machine state to 1 (online).
Version: 4.39
Release Date: 24/04/2024
Changed life_* fields to double.
Requires related schema updates in t_machines and t_machine_daily.
Version: 4.38
Release Date: 23/06/2023
For lines starting with PA2* that contain PA1* in the middle, the parser now trims the prefix and handles the line as a PA1* record.
Version: 4.37
Release Date: 08/12/2022
Updated DynamoDB DEX report mapping so imei remains the hash key and local_report_time remains the range key.
Changed report_time from range key to a normal DynamoDB attribute using Date.
Enabled DexReportTool main method for direct testing.
Added dex report generation and query tests in AppTest during Maven build.
Version: 4.36
Release Date: 12/09/2022
Stopped saving full DEX content into DynamoDB to reduce write cost.
Added reportTimeStamp(currentTimeMillis()/1000L) to DEX reports for TTL support.
Version: 4.35
Release Date: 21/03/2022
Fixed direct runtime issues under Tomcat.
Restored applicationContext.xml configuration to the 4.31 style.
disconnect() is now only called in Lambda.
Version: 4.34
Release Date: 17/03/2022
Added support for t_dtus.update_flag=6 to upgrade MDB Hat firmware on PI devices.
Version: 4.33
Release Date: 03/11/2021
Added handling for test2 and test2.fifo.
Moved report record saving to before report manager execution so Lambda always performs it.
Version: 4.32
Release Date: 02/11/2021
Added DEX forwarding support through forwardUrl in DexDecoding.properties.
Fixed the case where report manager is null under Tomcat.
Added support for the dataparsetestds scenario.
Version: 4.31
Release Date: 26/10/2021
Changed DEX sorting to always use local_report_time because report_time can be null.
Version: 4.30
Release Date: 13/10/2021
Adjusted DateUtil.getTimezoneTime behavior for Tomcat timezone handling.
Version: 4.29
Release Date: 12/10/2021
Changed dataparse decode to use AwsSqsConsumer instances.
Added Lambda controls for max_decode_thread_number and decode_seconds.
Version: 4.28
Release Date: 29/09/2021
Switched SQS processing to use a Java thread pool.
Version: 4.27
Release Date: 24/09/2021
In Lambda mode, receiving a DEX file no longer sends an SQS message because decoding is triggered by DynamoDB insert events.
Changed report manager invocation from HTTP URL calls to tomcat_vmms Lambda action calls.
Version: 4.26
Release Date: 08/09/2021
Introduced DataparseDecodeLambdaAdapter for DEX file parsing.
Added Lambda environment variables TZ and decode_enabled.
Added DynamoDB INSERT trigger support.
Version: 4.25
Release Date: 03/08/2021
Fixed timezone errors in report timestamps.
Version: 4.24
Release Date: 26/07/2021
Saved machine.lastUpdatedStamp in GMT after each report so offline calculation compares GMT values correctly.
Version: 4.23
Release Date: 19/07/2021
Fixed parsing for malformed parallel PA2 data where 0PA1 could appear inline.
Non-numeric trailing values in PA2 segments are now treated as 0.
Version: 4.22
Release Date: 14/06/2021
When writing to t_dex_reports, changed IMEI file time and local_report_time from GMT to the machine's own timezone.
Version: 4.21
Release Date: 26/05/2021
searchdex now reads DEX content from DynamoDB t_dex_reports first and falls back to S3 when needed.
Saving a machine's last report now happens immediately when a report is received.
Version: 4.20
Release Date: 27/04/2021
Refined the condition used to decide when life_bill_in should be divided by 100.
Version: 4.19
Release Date: 21/04/2021
Updated the life_bill_in decision rule introduced in 4.18.
Version: 4.18
Release Date: 29/03/2021
Restored the original life_bill_in and bill_in calculation behavior and added a guarded condition for /100 conversion.
Version: 4.17
Release Date: 22/03/2021
Unified life_bill_in and bill_in calculation rules.
Division by 100 now only happens when machine param DIV_100=true.
Version: 4.16
Release Date: 23/02/2021
Passed DEX content directly in the queue and only fell back to S3 if parsing could not find it.
Version: 4.15
Release Date: 11/02/2021
Treated server_id=vmms or missing server_id in t_dtulist as vmms.
Version: 4.14
Release Date: 09/02/2021
Added DynamoDB table t_dtulist.
Used serverId_imei as the primary key and updated the dictionary after each DEX upload.
Version: 4.13
Release Date: 27/01/2021
For Tomcat deployments, last_report is now saved using the user's current timezone.
Added split handling for DEX CB1 lines that contain embedded DA2 content.
Version: 4.12
Release Date: 22/10/2020
Updated the search DEX page to sort by time descending and display both date and time of report upload.
Version: 4.11
Release Date: 20/10/2020
Replaced MySQL t_dex_reports with DynamoDB t_dex_reports.
Added DynamoDB t_dtus while keeping MySQL t_dtus.