Skip to content

Releases: apdn7/AnalysisPlatform

v4.8.1

13 Oct 07:12
5575b80

Choose a tag to compare

Core changes

  • Added Snowflake to data source
    • We support two types of authentication: Access token and Key-pair
    • Please be aware that fees will be incurred when downloading data from Snowflake
    • The longer polling frequency (e.g. 1day), the lower the cost
    481_Snowflake

New features and improvements

  • (Common)

    • Register by file: Added a searchbox
      • Detected characters are highlighted
      481_Searchbox
    • When a process is selected in Show graph pages, it will also be selected in Filter processes if any Filter configuration exist
    • When only minimum or maximum Control Line is configured but not both, Process Capability Index (CP) will still be calculated
    • Now AP+DN7 cleans up inappropriate app.sqlite3 (configuration database) on activation
  • (Config)

    • Data Source Config: Added dropdown list to configure polling frequency for each data source
    481_PollingFrequency
    • Process Config: Columns with id in their names are automatically recognized as Main:Serial columns by default if no columns with Serial in their names exist
    • Process Config: A warning message is now shown when the user changes Judge variables in Process Configuration
    • Display Config: Valid From is now optional
    • A loading animation is now shown when the Process Config Register by File is rendering
    • A loading animation is now shown when the list of tables are retrieved from Database sources
    • Added option disable_config_from_external to startup.ini
      • Register/delete buttons are disabled when accessing the application from other clients
      • You can prevent the configurations from being accidentally changed or removed
      481_Startup 481_DisableConfig

Bug fixes

  • (Common)
    • Fixed an issue where AP+DN7 fails to avtivate when white spaces exist in the application path
    • Fixed an issue where jobs are delayed if the application has too many jobs
    • Fixed an issue where copy paste in visualization page generate empty rows
  • (Config)
    • Fixed an issue where registering data link can cause configured links to disappear
    • Fixed an issue where web cache causes registered processes to disappear
    • Fixed an issue where application cannot import csv folder correctly using python etl script
    • Now Register by File and Process Config is consistent in terms of data type estimation
  • (CHM)
    • Fixed an issue where copying users settings from CHM to AgP causes error due to different datetime format

v4.8.0

05 Aug 03:28

Choose a tag to compare

New features

  • (Common)
    • Added keyboard shortcuts
      • Ctrl + B to open Bookmark List
      • Ctrl + Enter to activate Display graph
      • Ctrl + / to open sidebar menu
      480_Shortcuts
    • Bookmark now stores timezone information, thereby ensuring that the result of Show Graph is consistent across different timezones
    • Now displays a warning when a filter process is specified without data linked to the selected processes in the Display Variable section
  • (Config)
    • Process Config: Added option Unique Values. This will show
      • Values at every 5th percentile for numeric columns
      • Most recent 10 unique values for categorical data
      480_UniqueSample
    • Process Config: Added Formula option for columns with datatype: Judge.
      Now we can define the definition of positive values and configure display values for positive and negative values  
      (Example of Judge setting)
    480_JudgeFormula
  • (FPP)
    • A specialized chart in FPP is now available for datatype: Judge.
      This chart displays the judge values, NG (Negative) ratio, cumulative sum and density
    480_FPP-Judge

Improvements

  • (Config)
    • Expanded the dropdown list for Function Configuration when selecting variables
    • Software workshop now automatically merges data of columns when they have the same name
    • All APIs no longer return Database passwords and Database configuration modal no longer autofills password.
      Saved password will be used to check the connection to registered databases when there is no input.
  • (RLP)
    • Now uses faster Kernel density estimation with binning and Fast Fourier Transformation

Bug fixes

  • (Common)
    • Fixed an issue with data grouping, leading to different results when facet or filter is used
    • Fixed an issue where empty file alerts are shown repeatedly in Register by File
  • (Config)
    • Fixed an issue where user is unable to overwrite saved datasources
    • Fixed an issue where me functions cannot be consistently saved
    • Fixed an issue where sample data for data link is not shown
    • Fixed an issue in Merge mode where a child column does not properly inherit properties from its parent
  • (FPP)
    • Fixed an issue where plot view fails to show for a process that is not linked
  • (RLP)
    • Fixed an issue where divs are sorted inappropriately
  • (ScP)
    • Fixed a performance issue due to fontawesome icons
  • (FPP/MSP)
    • Fixed an issue where PCP and MSP are unable to take screenshots

v4.7.10

02 Jun 08:58
b31f1c5

Choose a tag to compare

This version fixes the memory issue that occurred in version 4.7.9.

Improvements

  • Improved performance of frontend, especially when large amount of Processes/Variables are configured

Bug fixes

  • Resolved the memory issue that occurred in version 4.7.9
  • Fixed an issue that occurred in Windows 11, where AP+DN7 may not activate appropriately due to a disk capacity check
  • Fixed an issue in CHM, where "Start point" setting is initialized when loading a bookmark
  • Fixed an issue in CHM, where variables with datatype: Int are processed as categories instead of numbers

v4.7.9

08 May 11:29
41ceb44

Choose a tag to compare

New features

  • (Config)

    • You can now initialize a process by clicking the "Initialize" button.
      This function is used for example, change data types and re-import data.
    479_InitializeProcess
    • Spreadsheet-like editing is now available for filter config, display config and process config.
    479_SpreadsheetLikeEditor
  • (SkD)

    • Added a summary section to give summarized information and recommendations on how to proceed
    479_SkDSummary
    • Added "Strengthen selection" checkbox. This will re-draw SkD with strengthened (grid-searched) L1 penalty
    479_SkDStrengthenSelection
  • (Misc)

    • Added cookie banner / Cookie policy.
    • Added option enable_ga_tracking in startup.ini.
      By setting this value to 0, you can force to NOT send telemetry data.
    479_EnableTrackingParam
    • AP now stops the installation of Python embedded, Oracle portable and virtual environment when they exceed a certain amount of time
    • AP now checks for the amount of free disk space when starting the application.
      AP will require that there is at least 10% of total disk space + 1GB of free space.

Improvements

  • (Config)
    • Instead of directly using auto increment column,
      AP now groups data using the auto increment column to safely import long format data.

Bug fixes

  • (Config)
    • Fixed a bug where the data source could not be saved in certain case
    • Fixed an error message when CSV cannot be read with text encoding issue
    • Fixed a bug where graphs cannot be shown when a mix of Serial and Serial:Str are used
  • (FPP)
    • Fixed a bug where bar charts in FPP incorrectly occupies multiple ticks
  • (PCP)
    • Fixed a bug where axis ticks are not displayed correctly when only 1 and NA are present
  • (AgP)
    • Fixed a bug where AgP fails to show percentage in some cases
  • (Misc)
    • Fixed a bug where the Ctrl+Enter hotkey opens the sidebar search and shows graph at the same time

v4.7.8

26 Mar 09:10
6360a97

Choose a tag to compare

New features

  • (Common)
    • Added a search box on the sidebar.
      • You can search pages with the three letter abbreviation (esample: FPP), English, or by configured language.
      • Shortcut to move cursor to the searchbox: Ctrl + /
      • Also, you can press Enter to open the first page, Ctrl + Enter to open the first page in new tab.
      SerchboxOnSidebar
  • (Config)
    • Added backup/restore functionality
      • You can save backup of configurations and transaction data
      BackupRestore
    • Data Source Config: Added Python ETL capability.
      • For data that need customized preprocessing, you can use a Python script to perform ETL.
      • This functionality is currently only available for CSV/TSV.
      • Template file: \ap\script\user_scripts\py\template.py
      • .py files placed on the \ap\script\user_scripts\py will be listed up.
      PythonETL
    • Data Link Config: Now shows a preview for data link
      • PreviewDataLink
    • Function: Added "main::Serial" checkbox.
      • Now we can use variables defined in Function in process settings for data link.

Improvements

  • (Common)
    • Updated some python packages (for example, pandas)
    • Improved to redirect to the bookmarked page, after the terms of use is shown.
    • Added "New Tab" to the context menu displayed by right-clicking on the "Open" button in Bookmark page
    • Graph setting area: Improved performance of the rendering process for large number of variables
    • Graph settin area: Now we can switch the width of the system name shown
      • ChangeWidthOfSensorNames
  • (Config)
    • Now confirmation modal is displayed when there are unsaved changes on each config page
    • Data Source Config: Improved to show raw data for the preview
    • Process Config: Improved detection of data types for serial columns
    • Process Config: Datetime data with commas will be formatted to dots when previewing date and time data
    • Process Config: Only detect units those in DN7, when extracting units inside [ ] of column names.
    • Process Config: ncreased the number of data source names displayed in the data source dropdown from 10 to 30.
    • Process Config: Apply both Japanese and local names for reserved column name for certain data types
    • The config page can now be hidden only when accessed via an IP address
      • Change hide-setting-page parameter in the configuration file (.\AnalysisPlatform478_7770\ap\config\basic_config.yml) to true
  • (PCP)
    • Improved to enable cycle time analysis when selecting a date and time variable and jumping to PCP
  • (AgP)
    • For data export: "Filtered data", now aggregated (calculated) data is exported.
  • (SkD/GrL)
    • Added auto-update functionality
  • (Misc)
    • External API: Added /fpp, /pcp, /skd, /rlp, /chm, /msp, and added parameters to the Register from File API
    • Now AgP and RLP can jumped from all other pages
    • Improved to allow the target datetime range to be properly pasted into the target datetime values
      for Divide by category, Divide by term(Cyclic) and Divide by term(Direct) when copying settings to RLP or StP.
    • Now allowstable type value ('measurement' or 'history') of Software Workshop ETL

Bug fix

  • (Config)
    • Process Config: Fixed an issue where column names containing full-width alphabetic characters could not be imported
    • Process Config: Fixed a bug where column data types were not pasted correctly when using copy and paste function
    • Process Config: Fixed a bug where new records could not be imported after setting a function
    • Process Config: Fixed an issue where GeneratedDatetime could not be generated using the Main::Date and Main::Time columns if their names were duplicated
    • Process Config: Fixed an issue where FileName could not be imported in Process Merge mode
    • Data Link Config: Fixed a bug where nodes were not properly positioned
    • Filter Config: Fixed a bug where descriptions were not displayed when moving the mouse over column title
  • (FPP)
    • Fixed a bug where datetime values ​​were displayed in UTC time zone in label plots
  • (RLP)
    • Fixed a bug where NG rates could not be calculated when "No data link" was selected
    • Fixed a bug where NG rate data points were not vertically aligned with ridge line plots
    • Fixed a bug where EMD could not be displayed correctly when invalid data was at the beginning
  • (Misc)
    • Fixed a bug where Pulse in cleansing on the graph display page was incorrectly applied to category data
    • Fixed a bug where data from V2 csv files could not be read
    • Fixed a bug where historical data from V2 csv files could not be previewed due to normalization of process name strings
    • Fixed a bug in importing data from Software Workshop ETL

v4.7.7

22 Nov 12:32
e799221

Choose a tag to compare

Improvements

  • Now uses can sort columns by variable name on dropdown lists of setting area in visualization pages
  • Added No Data Link option in Full-points Plot (FPP)
  • Ridgeline Plot (RLP) now defaults to auto range for minimum and maximum axis value if either are set in Display Config
  • Datetime format now works against datetime values with 6 floating digits

Bug fix

  • Fixed some issues when using "Function" columns for On-demand filter
  • Fixed an issue where value of "NG Condition" is not loaded properly from Bookmark on RLP

v4.7.6

18 Nov 10:22
573c7ab

Choose a tag to compare

Bug fix

  • Fixed a bug where some data periods were not imported from a database
  • Fixed a bug where data preview did not appear in Process Config page from a database which has a date column
  • Fixed a bug where data importing failes when CSV/TSV file has an empty column name
  • Fixed a bug of significant digits on the Y axis of the graph in Full-points Plot (FPP)
  • Fixed a bug where some data periods to not be imported from the Software Workshop interface (PostgreSQL)

v4.7.5

04 Nov 19:52
b5ccacb

Choose a tag to compare

New features and improvements

  • (Common)
    • Improved overall performance of AP+DN7
    • Enable "Filter" checkbox of Display variable setting to all visualization tools
  • (PCP)
    • Enabled Auto-update
    • Improved computation time
  • (AgP)
    • Enabled Y-axis options
  • (ScP)
    • Now shows in 1:1 aspect ratio like HmP
  • (Config)
    • Config Page: Added search box to Dropdown lists on Data Source Config and Process Config
    • Data Source Config / Process Config: Now show raw data for datetime
    • Data Source Config: Now automatically preview data after path is given
    • Data Source Config: A more detailed warning message is now shown when a data file cannot be previewed
    • Process Config: Data type of columns with values all 0 or all 1 is now estimated as an integer
    • Process Config: Added an example of datetime format on hover message
    • Process Config: Filename is unchecked by default
    • Merge Mode: Improved visibility of sample data
    • Function: Improved visibility. You can now click expansion button of Function to automatically scroll down
    • Function: Search box in "New function" modal now has an 'x' (close) button to clear input
    • Register by file: Now assigns the file name instead of folder name as process name by default

Bug fix

  • (FPP)
    • Fixed a bug of rounding up the tick values of the Y axis incorrectly
  • (PCP)
    • Fixed a bug where Categorical-only mode can not be visualized
    • Fixed a bug where highlighting fails when the data does not have fully linked
    • Fixed a bug where incorrect graph range is applied after Display Config
  • (HMp)
    • Fixed a bug where unable to show graph with Category and String as input
  • (Config)
    • Data Link: Fixed a bug where autolink cannot be executed for DatetimeGenerated column
    • Data Import: Fixed a bug where files cannot be read with unicode_escape
    • Register by File: Fixed a bug where automatically fills Japanese instead of Local name in English language mode
    • Fixed a bug where some input fields (comment, datetime format, etc) are not reset upon closing modals
  • (Misc)
    • Fixed a bug where console window does not close automatically when shutting down AP+DN7

v4.7.4

17 Oct 03:48
d418318

Choose a tag to compare

New features and improvements

  • (Config)

    • Now automatically remove spaces at the beginning and end of the file/folder path given in Data Source Config and "Register by File" page
    • Fixed the name of "Data Source Type" options in Data Source Config
    • Improved to allow "Function" to be set at the same time as data import settings in Process Config
    • Fixed the description of the "extract.reg(X, s, t)" function in the regular expression string extraction of "Function"
    • Fixed the description of "Link with time" and "Cut off" that are displayed on the hover when linking datetime on Data Link Config
    • Changed to display the objective variable at the top when jumping from a page with an objective variable to a page without an objective variable using the jump function
    • Improved to allow the display order of processes to be rearranged in the dropdown for selecting processes on the visualization/analysis page
    SortProcess
    • Added a "Tooltips" button to toggle the display/hide of the hover that can be displayed from the graph
    SortProcess
  • (PCP)

    • Added an on/off toggle button for "Data View" to display details of the latest 20 records of the highlighted data
    SortProcess
    • The scale of the color bar now automatically adjusts to the data type. (For example, when the data type is "Judge" or "Boolean", only two scale values ​​are displayed)
  • (PCA)

    • Improved to allow seperate filters to training data and target data
      • For example, you can now train with only good product data and infer good/defective product data as target data
    • Added jump button
  • (AgP)

    • Changed to display OK in blue and NG in red for variables set to Judge data type
  • (SkD)

    • Removed unnecessary white space in the bar graph on the right side of the graph area
    • Improved the number of significant digits of the contribution value displayed on hover
  • (HMp)

    • Added "Filter" checkbox to the dropdown for selecting variables
    • Improved to make the aspect ratio of graphs

Bug fix

  • (Config)
    • Fixed a bug where the target data source was not deleted from the list when the data source was deleted in Data Source Config
    • Fixed a bug where suffixes for system names and Japanese/local names were not automatically generated when there were duplicate column names regardless of whether they contained full-width/half-width characters in Process Config
    • Fixed a bug where the "interval(X, a, b)" in "Function" did not work for datetime generated from date(main::Date) and time(main::Time) in Process Config
    • Fixed a bug where the estimated process order was sometimes displayed incorrectly in the "Auto link" function in Data Link Config
    • Fixed a bug where background jobs in the app were sometimes deleted when a new process was registered
  • (MSP)
    • Fixed a bug where "Process name" was displayed instead of "Variable name|Process name" when seven or more variables were selected
  • (ScP)
    • Fixed a bug where the color bar was not displayed when the X-Y axis was swapped
    • Fixed a bug where the color bar displayed incorrect scales when displaying a graph using time sorting and time progression

v4.7.3

18 Sep 11:07
c6323cb

Choose a tag to compare

New features and Improvements

  • (Common)

    • On-demand filter can now be applied when using Jump Function
    JumpODF
    • Visualization pages now opens with no bookmark loaded by default
    • Improved auto-scrolling after showing graph and scrolling buttons
    • When copying settings between pages, the time Window Length and Interval are now adjusted to keep the time period the same
    • Datetime can now be selected on Display Config page
    • Datetime can now be calculated as CT for PCP, SkD, PCA, GL pages
    • Copying User setting now copies the Outlier cleansing settings as well
    • Copying User setting from Stratified Plot to Ridgeline Plot now keeps the target period settings
    • X and Y axis can now be changed in ScatterPlot and HeatMap pages
  • (FPP)

    • Parallel Coordinate Plot now uses Auto Range by default
    • All columns in the dataframe can now be selected for X-axis ordering
    • The hover popup no longer go out of the browser's viewport
  • (PCP)

    • Enabled Y-axis scaling (Full range, Graph config, etc)
    • The latest 20 srecords within the selected data are now displayed in a table
    PCPDataPreview
  • (SkD)

    • The hover message in SkD now shows the positive/negative relationship between variables
  • (AgP)

    • AgP is now able to use a common scale for histogram and line charts respectively
  • (HMp)

    • X and Y values are now shown on hovers in HeatMap page
  • (Config)

    • New data types can now be used in Process Configuration: Judge and Boolean
    • Merge mode can now be used for databases
    • Sample Data in Function configuration can now be copied into a spreadsheet
    • Backup-Restore: Imported data can now be backed up and restored within a specified time period
    • Process Configuration for registered processes can now be viewed without connecting to the datasource
    • Process Configuration can now be downloaded instead of copying to clipboard when APDN7 is accessed through an IP address
    downloadconfig
    • Sample data in Function Configuration page now shows the top 50 results by unique X-Y pairs
    • Merge function now works better with mixed datatypes between X and Y
    • Process Configuration modal now has explanation for some data types
    • Register By File now jumps to FPP instead of CHM after importing is finished if dummy_datetime is present
    • Optimized the speed for data link using datetime-cutoff
    • Improved responsive styling of the Function Configuration modal
    • Filter name in Filter Configuration page is now auto-filled when selecting a column
    • Master filters are not automatically selected as filters and labels in Show graph pages. PartName, PartNo, LineName, LineNo are selected for the first process only.
    • Datasource preview now shows rows with NA values
    • In Function Configuration modal, function sample data rows are not sorted in X -> Y -> Result priority, and NA values are at the bottom
    • Function Configuration now shows both local and system names for columns in the input selection
  • (Misc)

    • Now Register by File page supports V2 CSV files
    • Support new data source: Software workshop databases
    • The Jump Function modal can now be filtered, and has Auto Select, Select all checkboxes

Bug fixes

  • (Common)
    • Fixed an issue where a column is not moved to the top of the list when selected as Facet or Div in Show graph pages
  • (FPP)
    • Fixed an issue where outlier points do not lie at the edge of FPP charts
  • (PCP)
    • Fixed a bug where categories are wrongly sorted
    • Fixed an issue where the "Move next to target variable" button in Parallel Coordinate Plot fails to work
    • Fixed a display bug where NA and Infinite values have the wrong color in Parallel Coordinate Plot
  • (SkD)
    • Fixed an issue where SankeyDiagram fails to show binary classification mode when there are NA values in the data
  • (RLP)
    • Fixed an issue where the Graph settings option does not work correctly for RLP
  • (Config)
    • Data sources and processes created through Register By File page can now be previewed
    • Autolink fails due to lack of delta_time and cut_off fields
    • Fixed a bug where Auto Select does not work properly in Process Config modal
    • Fixed a bug where Merge Mode returns an error when merging Float data into an Integer column
    • Fixed an issue where datetime format is not applied after changing the datatype of a column in Process Config modal
    • Fixed an issue where job status is not shown in Process Config page
    • Fixed a bug where confirmation modal appears even when no changes are made to a function
    • Fixed a display bug where long column names cause text to overflow in Function Config
    • Fixed an issue where a failed validation remains even after changing function
    • Fixed an issue where X and Y cannot be selected after selecting me.type.convert(t)
    • Fixed a bug where filling a process name in Process Config screen does not fill the process name field in the Process Config Modal
    • Fixed an issue where duplicate column names are not automatically parsed in Process Config page and data import fails against duplicate column names with "_" character
    • Fixed a problem where preview of database leads to an error if database has boolean data
  • (HMp)
    • Fixed an issue in HeatMap page where a wrong message is shown when showing graph
    • Fixed an issue where HeatMap page shows a wrong color scale for binary and integer cases
  • (Misc)
    • Fixed a bug where using Jump Function alters the copied setting
    • Fixed an issue where child processes appear in Table Viewer and Filter pages
    • Fixed a display bug where milliseconds are displayed for time data in HeatMap and ScatterPlot pages
  • (ScP)
    • Fixed an issue where ScatterPlot shows a wrong color scale when Integer is selected as Color