Skip to content

Spark Doris Connector Release Note 1.3.2 #203

@JNSimba

Description

@JNSimba

Features & Improvements

  1. Reconstruct Loader writing and Support writing in copy mode [refactor](load) Refactor the loader to expand the way data is written #187 [refactor](load) Support loader with copy into #190
  2. Write to support https [feature] support fe https request #189
  3. Support reading varint ipv4 ipv6 and other types [feature]support read ipv4/ipv6 data type #199 [feature] support variant type #197
  4. Support doris2.1 date/datetime reading format [improvement] Compatible with arrow serialization type modifications for date/datetime #193

Bug

  1. Fix the problem of error reporting when column name is keyword when writing [fix] stream load's colunms can use keyword with sparksql #186
  2. Fix the problem of data duplication caused by repartition [Bug] Fix data duplication caused by repartition #191
  3. Fix the problem of data duplication during retry

Behavior Change

  1. Some default values of Reader have been modified [improvement] change config default value for read optimization #196

Thanks

@gnehil
@JNSimba
@lxwcodemonkey
@smallhibiscus
@vinlee19

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions