Blog entries

Tensei-Data available from Github and the archive of the Free Software Foundation

Submitted by admin on Thu, 02/08/2018 - 12:30

From now, the Tensei-Data system and its resources can be used from the official Github repository and the archive of the Free Software Foundation.

Resources on Github

Resources on Free Software Foundation

Core application

DFASDL - Data Format and Semantics Description Language

Tensei-Data 1.13.3 Announcement

Submitted by Jens Grassel on Fri, 06/02/2017 - 14:13

We just released version 1.13.3 of Tensei-Data.

Summary of Changes

This release contains an important fix that prevents crashed transformers to cause endless running jobs under some circumstances.

Remember that a free license is included in each release which allows the usage of one agent and up to three transformation configurations. For details see our license information page.

To try it out simply run vagrant init wegtam/tensei-demo; vagrant up --provider virtualbox.

Changed

  • lots of code cleanup

Fixed

  • crashed transformers cause endless running

Update demo version

To update the demo version you can use the following sequence of commands. Please export your cookbooks before doing this if you don't want to loose them.

vagrant box update
vagrant destroy
vagrant up

Tensei-Data 1.13.2 Announcement

Submitted by Jens Grassel on Wed, 05/24/2017 - 09:29

We just released version 1.13.2 of Tensei-Data.

Summary of Changes

Some bugfixes and enhancements regarding DFASDL validation from the editor were made. If you're using reserved sql names which might be mapped to table or column names in a database then a warning will be issued upon validation. Additionally downing of unreachable frontend nodes in the akka cluster will be performed by the server watchdog.

Remember that a free license is included in each release which allows the usage of one agent and up to three transformation configurations. For details see our license information page.

To try it out simply run vagrant init wegtam/tensei-demo; vagrant up --provider virtualbox.

Added

  • warning if usage of reserved sql names for tables or columns is detected

Changed

  • better error messages for DFASDL validation
  • watchdog will remove unreachable frontend nodes from the cluster

Fixed

  • DFASDL validation shows no error upon server error

Update demo version

To update the demo version you can use the following sequence of commands. Please export your cookbooks before doing this if you don't want to loose them.

vagrant box update
vagrant destroy
vagrant up

Tensei-Data 1.13.1 Announcement

Submitted by Jens Grassel on Thu, 05/18/2017 - 14:24

We just released version 1.13.1 of Tensei-Data.

Summary of Changes

Some bugfixes regarding export and import of cookbooks were made. Also a change under the hood regarding a secure number generator was made to prevent systems with low entropy to block forever.

Remember that a free license is included in each release which allows the usage of one agent and up to three transformation configurations. For details see our license information page.

To try it out simply run vagrant init wegtam/tensei-demo; vagrant up --provider virtualbox.

Changed

  • cookbook export now in binary format

To convert your old exports into the new format you can simply gzip them but be sure to have them encoded using UTF-8.

Gzip old cookbook

% gzip -9 my-old-cookbook.json

Convert and gzip wrong encoded old cookbook

% iconv -f OLD-ENCODING -t UTF-8 my-old-wrong-encoded-cookbook.json | gzip -9 > my-old-cookbook.json.gz

Fixed

  • forcing import of cookbook fails
  • cookbook import fails if file encoding was changed
  • strong secure random number generator blocks endless on systems with low entropy
  • usage of java.io.FileInputStream and java.io.FileOutputStream considered harmful

Update demo version

To update the demo version you can use the following sequence of commands. Please export your cookbooks before doing this if you don't want to loose them.

vagrant box update
vagrant destroy
vagrant up

Tensei-Data 1.13 Announcement

Submitted by Jens Grassel on Wed, 05/03/2017 - 12:53

We just released version 1.13.0 of Tensei-Data.

Summary of Changes

From this release on forward Tensei-Data is free to use!

A free license is included in each release which allows the usage of one agent and up to three transformation configurations. For details see our license information page. Further changes include bug fixes and restructuring work.

To try it out simply run vagrant init wegtam/tensei-demo; vagrant up --provider virtualbox.

Fixed

  • under rare circumstances an agent is not initialised with a name
  • White Screen of Death upon import of broken cookbook files

Update demo version

To update the demo version you can use the following sequence of commands. Please export your cookbooks before doing this if you don't want to loose them.

vagrant box update
vagrant destroy
vagrant up

Tensei-Data 1.12.1 Announcement

Submitted by Jens Grassel on Wed, 03/22/2017 - 16:08

We just released version 1.12.1 of Tensei-Data.

Summary of Changes

This is a bugfix release which is highly recommened for all users. A regression was introduced that could under some circumstances lead to corrupted data if conversions between different encodings are necessary.

Fixed

  • conversion between different encodings breaks sometimes

Update demo version

To update the demo version you can use the following sequence of commands. Please export your cookbooks before doing this if you don't want to loose them.

vagrant box update
vagrant destroy
vagrant up

Get your free trial version

You can try the Tensei-Data system for free. Just request a free trial version and receive a 14 days free license.

Tensei-Data 1.12 Announcement

Submitted by Jens Grassel on Mon, 03/13/2017 - 17:44

We just released version 1.12 of Tensei-Data.

Summary of Changes

This release fixes a lot of potential issues with string handling regarding different locales. We also removed a lot of unused code and last but not least we bring in special treatment of Microsoft Excel files due to popular demand. If a connection information points to a local excel file it will be transformed on the fly during schema extraction and transformation. For this to work properly you have to specify the locale of the file which is used to read date, time values and numbers from the excel file.

Added

  • parameter locale for LowerOrUpper transformer
  • support encoding specification for dfasdl schema extractor on local files
  • use default encoding from dfasdl schema if no element encoding is set
  • transparent conversion of Microsoft Excel files upon schema extraction and processing

Changed

  • update to latest version of Akka
  • update to latest version of database drivers

Removed

  • settings and support for encoding detection (It never worked sufficiently.)
  • remove unused code

Fixed

  • use of lower and uppercase string functions lead to locale specific issues
  • LowerOrUpper transformer issues related to locale

Update demo version

To update the demo version you can use the following sequence of commands. Please export your cookbooks before doing this if you don't want to loose them.

vagrant box update
vagrant destroy
vagrant up

Get your free trial version

You can try the Tensei-Data system for free. Just request a free trial version and receive a 14 days free license.

Tensei-Data 1.11 Announcement

Submitted by Jens Grassel on Fri, 01/20/2017 - 11:57

We just released version 1.11 of Tensei-Data.

Summary of Changes

This release contains minor changes and bugfixes which are not directly visible to the user. The most noteable change is a display of an introduction to the concepts of Tensei-Data for users that login for the first time.

Known Issues

If you experience an error message in the frontend when validating a DFASDL that complains about unknown "dfasdl-attributes-root" xml stuff then you are affected by an issue that we were unable to fully reproduce and solve. It might be triggered by a strange combination of vm and jvm startup stuff that messes up resource loading via classpath. The actual error message will most likely look like this:

To fix this issue the frontend service has to be restarted. Simply issue the following command from the terminal where you started the demo version:

vagrant ssh -c "sudo service tensei-frontend restart"

Update demo version

To update the demo version you can use the following sequence of commands. Please export your cookbooks before doing this if you don't want to loose them.

vagrant box update
vagrant destroy
vagrant up

Get your free trial version

You can try the Tensei-Data system for free. Just request a free trial version and receive a 14 days free license.

Tensei-Data 1.10 Announcement

Submitted by Jens Grassel on Wed, 01/04/2017 - 13:44

We just released version 1.10 of Tensei-Data.

Summary of Changes

The memory footprint of the agent has been reduced by 42% in this release. Support for triggers based on jetty was removed. A lot of small fixes happened on the frontend side which now uses an embedded database by default. You may switch to a postgresql database via configuration.

Added

  • transformation configurations are marked "dirty" if connected cookbook changes dfasdl resources
  • allow the same configuration information to be used multiple times within a transformation configuration
  • support embedded database
  • allow changing to PostgreSQL by configuration
  • link to free trial request from license page

Changed

  • use embedded database by default
  • reduce memory footprint of agent by 42%

Removed

  • support for jetty triggers because of instabilities and crashes

Fixed

  • link to cookbook editor broken on detail page
  • changing dfasdl resources in cookbook breaks transformation configurations
  • execution of "dirty" transformation configurations possible
  • several bugs in database code
  • license details not shown on license page
  • crash when renaming a cookbook

Known Issues

If you experience an error message in the frontend when validating a DFASDL that complains about unknown "dfasdl-attributes-root" xml stuff then you are affected by an issue that we were unable to fully reproduce and solve. It might be triggered by a strange combination of vm and jvm startup stuff that messes up resource loading via classpath. The actual error message will most likely look like this:

To fix this issue the frontend service has to be restarted. Simply issue the following command from the terminal where you started the demo version:

vagrant ssh -c "sudo service tensei-frontend restart"

Update demo version

To update the demo version you can use the following sequence of commands. Please export your cookbooks before doing this if you don't want to loose them.

vagrant box update
vagrant destroy
vagrant up

Get your free trial version

You can try the Tensei-Data system for free. Just request a free trial version and receive a 14 days free license.

Tensei-Data 1.9.2 Announcement

Submitted by Jens Grassel on Wed, 11/30/2016 - 09:12

We just released version 1.9.2 of Tensei-Data.

Summary of Changes

The last vagrant box contained some corrupted files. Therefore we re-packaged it and included some fixes as well.

Added

  • log rotation for frontend logs

Changed

  • frontend logfile renamed from application.log to tensei-frontend.log

Fixed

  • license expiration date not shown correctly
  • Internal Server Error if dfasdl schema (xsd) could not be loaded

Known Issues

If you experience an error message in the frontend when validating a DFASDL that complains about unknown "dfasdl-attributes-root" xml stuff then you are affected by an issue that we were unable to fully reproduce and solve. It might be triggered by a strange combination of vm and jvm startup stuff that messes up resource loading via classpath. The actual error message will most likely look like this:

To fix this issue the frontend service has to be restarted. Simply issue the following command from the terminal where you started the demo version:

vagrant ssh -c "sudo service tensei-frontend restart"

Update demo version

To update the demo version you can use the following sequence of commands. Please export your cookbooks before doing this if you don't want to loose them.

vagrant box update
vagrant destroy
vagrant up

Get your free trial version

You can try the Tensei-Data system for free. Just request a free trial version and receive a 14 days free license.