2022.06.20 version update-all new and suitable data factory

版本权益: VIP version/professional/Exclusive Edition

YIDA data factory is here

• YIDA [cool data] capabilities are further upgraded. The original [application data management] module is upgraded to [data factory] to fully manage all data capabilities under this application.
• The capabilities section of [data factory] includes: Dataset, data source, View chart, data preparation, and dataset service opening (planned)
• [Data factory] is a complete data processing workshop, which can be used to manage data materials, process data materials, aggregate data assets, create real-time and offline datasets, and manage dataset permissions. Based on the data management perspective of YIDA applications, all data-related functions are converged to [data factory] for unified management.
• The newly revised [data preparation] has stronger capabilities and easy-to-use experience. It also provides an independent portal to support list management and task operation and maintenance management of data preparation instances.

Once upon a time	Now
Application Data Management: 1. Dataset and multi-table Association capabilities	Data factory: DataSet (DataSet): YIDA standard data processing unit Data source (DataSource): supports direct connection to enterprise databases, and analysis of attendance and OA data on DingTalk (recently launched) Data Preparation (DataPrepare): the new zero-code ETL function supports joint analysis of 20 input datasets, hourly Big Data running speed, and rich data processing capabilities.

Data factory introduction:

• Based on the data management perspective of YIDA applications, all data-related functions are integrated into the new data factory.
• [Data factory] is a complete data processing workshop YIDA, which can be used to manage data materials, process data materials, aggregate data assets, create real-time and offline datasets, manage dataset permissions, insight into the value of business data.

New Release 1: New 0 code ETL

New data preparation

• Use the 0-code ETL solution (Extraction-Transformation-Loading) to easily integrate scattered data from all parts of the enterprise to YIDA to solve complex big data processing problems. Process various datasets within YIDA.
• As an enterprise low-code application development platform, YIDA supports application data within YIDA, enterprise external database data, enterprise external file data, and DingTalk official data (it is planned to support contacts, OA, attendance and other data are quickly analyzed on YIDA).
• In the data factory, the latest version of the data preparation function is also organized. In the organization that joins the internal test, you can see the independent [data preparation] function Portal, each data preparation instance can manage and View update logs on the list page.

Version limits:

• Only YIDAVip versionAndHybrid cloud edition
• During the gray scale period, each VIP version Enterprise provides 20 data preparation instances, that is, the number of data streams created.

Get started quickly:

1. Select the data preparation tab and click the new data preparation button to automatically jump to the data preparation visualization page.

2. Drag one or more [input nodes] to implement data processing with [association], [merge], [aggregation], and [cleaning] nodes as needed, finally, connect the processed data to an output node, configure the dataset name, and click save, publish, and run.

3. By default, each data preparation instance that passes the verification rule is automatically run every hour to update the dataset corresponding to the output node based on the latest data at that time. After the data preparation rule is configured, it is executed every hour by default. You can view the details of each task through the run log. (More diversified operating rules will be supported in the future).

4. By performing different data processing operations on the data of the input node, the output dataset is finally generated.

New release 2: Data big screen upgrade

• YIDA built-in DataV engine-based data big screen, big screen designer adds 2 new capabilities

Capability 1: Add API methods to data sources

• In addition to the YIDA built-in dataset list, the YIDA built-in large screen allows you to use the existing API data interface more conveniently. The large screen data source is more flexible and supports two request modes: Get and Post.

• FAQ: how to configure cross-domain interfaces:https://help.aliyun.com/document_detail/64140.html

Capability 2: Add blueprint interaction

• Supports the blueprint configuration capability of DataV and improves the large screen interface to provide richer product interaction configurations.
• 

Blueprint Configuration tutorial, for more information, seehttps://help.aliyun.com/document_detail/117859.html