Skip to content

3.3.0-alpha

Latest
Compare
Choose a tag to compare
@SbloodyS SbloodyS released this 08 Apr 01:40

DSIP

Click to expand
  • [DSIP-19] Support zeppelin connections in the connection center, as well as external connections to the connection center in zeppelin tasks (#14434) @xdu-chenrj
  • [DSIP-19] Support sagemaker connections in the connection center, as well as external connections to the connection center in sagemaker tasks (#14976) @xdu-chenrj
  • [DSIP-19] Support k8s connections in the connection center, as well as external connections to the connection center in k8s tasks (#14977) @xdu-chenrj
  • [DSIP-24][RemoteLogging] Support AbsRemoteLogHandler (#15769) @pegasas
  • [DSIP-26][Audit log] Audit log improvement design (#15554) @qingwli
  • [DSIP-25][Remote Logging] Split remote logging configuration (#15826) @pegasas
  • [DSIP-44] Set a delay time to TaskExecuteRunnable if it dispatched failed (#16069) @ruanwenjun
  • [DSIP-45] Polish the Storage SPI (#16141) @ruanwenjun
  • [DSIP-46] Unify the logic task params data structure between front-end and back-end (#16193) @ruanwenjun
  • [DSIP-50][UDF Manage] Remove unused udf manage function (#16212) @SbloodyS
  • [DSIP-51][Task] Remove unused pigeon task plugin (#16219) @SbloodyS
  • [DSIP-54][Master] Use ClusterManager to manage the cluster in master (#16263) @ruanwenjun
  • [DSIP-53] Suggest add process lineage parsing for dependent task (#16288) @SbloodyS
  • [DSIP-56] Refactor JDBC registry support session timeout and data change event (#16287) @ruanwenjun
  • [Improvement-16122][Authentication] Improvement k8s resource center statement (#16123) @pegasas
  • [DSIP-57][Audit] Revert PR 14981 code (#16370) @SbloodyS
  • [DSIP-59] remove single task definition code and ui (#16397) @SbloodyS
  • [DSIP-60][Http task plugin] Refactor http task plugin (#16413) @SbloodyS
  • [DSIP-62][Http Alert Plugin] Refactor http alert plugin (#16484) @SbloodyS
  • [DSIP-61][Master] Refactor thread pool and state event orchestration in master (#16327) @ruanwenjun
  • [DSIP-67] Use command to trigger workflow instance rather generate workflow instance (#16523) @ruanwenjun
  • [Improvement-16516] Uniformly name process in backend code as workflow (#16524) @SbloodyS
  • [Improvement-16537][API] Fix typo on api workflow parallel backfill (#16538) @pegasas
  • [DSIP-70] Deprecated upgrade code of 1.x and 2.x in 3.3.0-release (#16551) @SbloodyS
  • [DSIP-65] SubWorkflow logic task support pause/kill/recover (#16566) @ruanwenjun
  • [DSIP-68] Unify the table structure and table fields in backend and frontend ui sections (#16544) @SbloodyS
  • [DSIP-75] Support auto add license header by spotless (#16643) @ruanwenjun
  • [DSIP-38] Add plugin directory in binary package (#16613) @SbloodyS
  • [DSIP-38] Support upload/download plugins from maven repo (#16654) @SbloodyS
  • [DSIP-78][Data Quality] Remove data quality module (#16794) @SbloodyS
  • [DSIP-38] Optimize dependency tree (#16838) @SbloodyS
  • [DSIP-73] Add dolphinscheduler-task-executor module to unify the task execution logic (#16790) @ruanwenjun
  • [DSIP-72][Dynamic Task] Remove dynamic task type (#16842) @SbloodyS
  • [DSIP-27][Task Plugin] Some improvements of JAVA task plugin (#16542) @ailiujiarui
  • [DSIP-87] Remove cache configuration of task (#16892) @ruanwenjun

Feature

Click to expand
  • [Feature-14832][Listener]Implementation of Listener Mechanism (#14981) @weixiaonan1
  • [feature#14654] alert-spi support prometheus alertmanager (#15079) @xjlgod
  • [Improvement][Alert] Add a test send feature when creating an alert instance (#15163) @qingwli
  • [Feature-15248][dolphinscheduler-alert-plugins] add alert plugin aliyun-voice (#15248) @xujiaqiang
  • [Feature] timed scheduler Improvement (#15449) (#15450) @ly109974
  • [Feature-14863][API] Support to manage what worker groups can be used for a project. (#15600) @calvinjiang
  • [Feature-16229] Add python using file e2e test case (#16240) @SbloodyS
  • [Feature-16269][dinky-task]Supports dinky tasks to accept Prepare Params passed within a task or from a previous task (#15947) @gaoyan1998
  • [Feature-16132][Task Plugin] support for oceanbase datax task (#16281) @xxsc0529
  • [Feature-16127] Support emr serverless spark (#16126) @EricGao888
  • [Feature-10872][UI] Display the total count in all listing page (#16590) @SbloodyS
  • [Feature-16396][storage-plugin] Add Tencent Cloud COS Storage Plugin (#16565) @Mighten
  • [Feature-16608][Doc] Add Security Model for DS (#16609) @wangxj3
  • [Feature-16801][UI] Add copy path of resource file in task definition (#16803) @SbloodyS
  • [Feature-16834] Start worker node with worker group label (#16875) @SbloodyS

Improvement

Click to expand

Bugfix

Click to expand
  • [Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue (#14992) @qingwli
  • [Fix] Change HTTP plugin timeout param to number type (#15234) @qingwli
  • [Fix] Fix k8sTaskExecutionContext setting configYaml (#15116) @xdu-chenrj
  • [Fix][UI] When you edit a task in the task definition list, the front task list is displayed (#12819) @clovelll
  • [Fix] ddl without drop exists (#14128) @zhongjiajie
  • [Fix] Fix jdbc registry cannot work (#15861) @ruanwenjun
  • [Fix-16061] modify log msg in WorkflowExecuteRunnable#isTaskDepsComplete() (#16062) @alei1206
  • [Fix][UI] ensure number type field has number type value when edting alarm instance (#16089) @rockfang
  • [Fix][UI] Fix the message toast issue (#16088) @rockfang
  • [Bug] Fix Complement data Tenant abnormality (#16092) @changxiangshimian
  • [Chore ] CI add auto-assign-action (#16165) @SbloodyS
  • [CI] Fix ci auto assign error (#16171) @SbloodyS
  • [Fix] Fix HdfsStorageOperatorTest NPE (#16178) @ruanwenjun
  • [CI] Fix CommandDaoImplTest might failed (#16175) @ruanwenjun
  • [Fix-16290] Filter the NaN of system_cpu_usage/process_cpu_usage (#16289) @ruanwenjun
  • [Fix-16295][Task] Remote Shell Task plugin run error (#16296) @wangbowen1024
  • [Fix-16279] Support Java 8 date/time type java.time.OffsetDateTime (#16304) @xxzuo
  • [Fix-16322] Set default registry-disconnect-strategy:strategy to stop (#16323) @ruanwenjun
  • [Fix-15644][ui] fix ui Failed to query list after editing file (#15647) @bajiaolong
  • [Fix-16329] Fix offline workflow error (#16330) @SbloodyS
  • [Fix-15519] Polish datax task docs (#16325) @SbloodyS
  • [Fix-16308] Fix query resources list paging error and docs. (#16324) @SbloodyS
  • [Fix-16347] Fix JdbcRegistry will get duplicate children (#16348) @ruanwenjun
  • [Fix-15828] fix expandListParameter (#15878) @xxzuo
  • [Fix-16353][dao] Fix incorrect parameter name 'processLineages' in batchInsert method (#16354) @starrysxy
  • [Fix-16346] Fix a bug that prevents re-uploading resource files (#16356) @JohnZp
  • [Fix-16388][Helm] fail to change updateStrategy from RollingUpdate to onDelete (#16389) @Gallardot
  • [Fix-16428] only admin user can grant datasource (#16429) @wangxj3
  • [Fix-16424] K8sUtils#jobExist may cause huge memory usage (#16432) @ChaoquanTao
  • [Fix-16374][dolphinscheduler-alert] Fix DingTalk replace the atUserIds parameter with atDingtalkIds (#16379) @xxzuo
  • [Fix-16464] [pom] fix parent pom plugin config error (#16463) @chenss-1
  • [Fix-16382] Fix the bug of async master task casthread pool invocations ramp-up (#16461) @Dyqer
  • [Fix-16475][UI] Can't SET Timing successful in Workflow Definition grid (#16476) @topsli
  • [Fix-16492][alert] FeiShuSender Exception.getMessage is null (#16498) @saowu
  • [Doc-16490] Changed some notes about python gateway service (#16493) @BruceWong96
  • [Fix-15961] [UI] Rename pythonCommand to pythonLauncher in pytorch task. (#16495) @cncws
  • [Doc-16535] remove doc of extra ssh task node type (#16536) @wangxj3
  • [Fix-16569][alert] Feishu send alert message failed (#16588) @saowu
  • [Fix-16629][UI][Workflow Instance] fix status display error (#16630) @sdhzwc
  • [Fix-16338][Test] Fix Master integration test case has been skipped in ci (#16637) @ruanwenjun
  • [Fix-16567] Unable to delete copied nodes in unsaved workflow (#16576) @Xuxiaotuan
  • [Fix-16650] Memory leaks in KubernetesApplicationManager (#16652) @ChaoquanTao
  • [Fix-16655][Doc] Fix the missing document (#16666) @SbloodyS
  • [Fix-16578] Fix environment resource permission (#16579) @wangxj3
  • [Fix-16680][ApiServer] Query project list paging error (#16681) @shouwangyw
  • [Fix-16692][Doc] Incorrect docs of howto (#16693) @SbloodyS
  • [Fix-16700] [doc] The Vertica datasource is under "Introduction to Function" (#16701) @FrommyMind
  • [Fix-16705] [Built-in Parameter] Fix project name and definition name variable parameter not resolved (#16715) @sdhzwc
  • [Fix-16740][SeaTunnel-Task] fix can't submit resource center config file issue (#16741) @liunaijie
  • [Fix-16517][Alert Instance] Alert plugin instance i18n wrong result in rendering frontend ui (#16751) @sdhzwc
  • [Fix-16764] Tasks dispatched failed weren't delayed properly as documented in GlobalTaskDispatchWaitingQueueLooper (#16763) @slimtom95
  • [Fix-16770] [Workflow State Statistics] Fix workflow state statistics status shows error (#16771) @sdhzwc
  • [Improvement-16773][Parameter] Create project parameters-Field modify user adds default value (#16775) @sdhzwc
  • [Fix-16786][Datasource] Fix jdbc connect parameters json validation question (#16787) @sdhzwc
  • [Fix-16783][Datasource] Fix switching multiple data sources, displaying field errors (#16784) @sdhzwc
  • [Fix-16793] WorkerGroupChangeNotifier may can not detect cluster's first time change (#16796) @reele
  • [Fix-16331] Fix the resource file cannot be displayed hierarchically (#16799) @SbloodyS
  • [Fix-16813] Missing implememts in isTaskExecutionRunnableForbidden (#16814) @reele
  • [Fix-16820][Alert] fix alert status after alert sent by AlertSender (#16824) @toujours33
  • [Fix-16811] [JdbcRegistry] Clear the jdbc EPHEMERAL data and lock which client is not exist (#16837) @ruanwenjun
  • [Fix-16849] load-balance configuration documentation description issue (#16851) @SbloodyS
  • [Fix-16884] Using transaction when fetch command to avoid fetch command from slave database (#16885) @ruanwenjun
  • [Fix-16906] Fix tenant has no permission to execute kill command (#16909) @ruanwenjun
  • [Fix-16914] [Task] ParameterUtils will throw exception when the input contains '$[xx]' (#16916) @ruanwenjun
  • [Fix-16900][api] fix when the copied workflow, the logical node switch loses the flow relationship (#16911) @llllkid
  • [Fix-16940] Fix incorrect docs link in priority parameter (#16941) @SbloodyS
  • [Fix-16918][Task] Fix wrong permissions configuration while executing shell (#16923) @BruceWong96
  • [Fix-16942] Fix global master failover might cause master dead (#16953) @ruanwenjun
  • [Fix-16934][api] When creating workflows containing switch nodes in different orders, the copied workflows may lose associations. (#16939) @llllkid
  • [Chore] python gateway unable to execute workflow (#16969) @zhongjiajie
  • [Fix-16903] Fix monitor page cannot display well (#16968) @ruanwenjun
  • [Fix-16978][Master] Fix AbstractDelayEvent compare method is incorrect (#16980) @reele
  • [Fix-16627] [dolphinscheduler-api] LoginHandlerInterceptor.preHandle check session without expire time check (#16989) @ruanwenjun
  • [Fix-16990] Fix WorkflowExecutionGraph#isTaskFinish is not working correctly (#16995) @ruanwenjun
  • [Fix-16991] Missing environmentConfig when retry/failover/recover task instance (#16998) @ruanwenjun
  • [Chore] Fix workflow is offline can be trigger (#17008) @ruanwenjun
  • [Fix-17004] Fix process termination logic in cancelApplication method (#17005) @davidzollo
  • [Fix-17019][Task Api] Missing execute path in resource limit mode. (#17020) @CommandCV
  • [Fix-17022][tools] SQL syntax error at upgrade sql file in 3.2.0_schema (#17028) @weideguo
  • [Fix-17030] Fix one task might be duplicate trigger if exist multiple predecessors (#17038) @ruanwenjun
  • [Fix-17036] Fix kerberos will not refresh in HdfsStorageOperator (#17039) @ruanwenjun
  • [Fix-17050][Master] Fix workflow graph topology logical error (#17051) @MYssq
  • [Fix-17055] Fix nextBranch is empty in switch task (#17054) @ruanwenjun
  • [Fix-17052][UI]Fix ui-setting route with the same name (#17053) @det101
  • [Fix-17071][UI] correct datasource list id (#17072) @liunaijie
  • [Fix-17023] Fix split and remove comment error in Doris task. (#17070) @yingh0ng
  • [Fix-17078] Revert 11726 (#17080) @ruanwenjun
  • [Fix-17073]Fix DataSource/JDBC connection failure (#17081) @tusaryan
  • [Chore] Remove channelsLock on onChannelInactive to avoid deadlock (#17084) @ruanwenjun

Document

Click to expand

Chore

Click to expand