Skip to content

Commit 4406677

Browse files
SparkSnailSparkSnail
committed
update readme
1 parent ab50ee2 commit 4406677

File tree

1 file changed

+266
-0
lines changed

1 file changed

+266
-0
lines changed

‎docs/release-notes/v2.3.0-rc1/release-2.3.0-rc1.md‎

Lines changed: 266 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,266 @@
1+
# .NET for Apache Spark 2.3.0-rc1 Release Notes
2+
3+
### New Features/Improvements
4+
5+
* Spark 3.3 support ([#1185](https://github.com/dotnet/spark/pull/1185))
6+
* Spark 3.4 support ([#1205](https://github.com/dotnet/spark/pull/1205))
7+
* Spark 3.5 support ([#1178](https://github.com/dotnet/spark/pull/1178))
8+
* Migrated to MessagePack instead of BinaryFormatter ([#1202](https://github.com/dotnet/spark/pull/1202))
9+
* Updated Dotnet and Arcade ([#1197](https://github.com/dotnet/spark/pull/1197))
10+
> Updated .Net6 -> .Net8
11+
> Updated .Net Framework 4.6.1 -> 4.8
12+
13+
14+
### Bug Fixes
15+
16+
* None
17+
18+
### Infrastructure / Documentation / Etc.
19+
20+
* Components overview and pipeline sequence ([#1189](https://github.com/dotnet/spark/pull/1189))
21+
22+
### Breaking Changes
23+
24+
* None
25+
26+
### Known Issues
27+
28+
* None
29+
30+
### Compatibility
31+
32+
#### Backward compatibility
33+
34+
The following table describes the oldest version of the worker that the current version is compatible with, along with new features that are incompatible with the worker.
35+
36+
<table>
37+
<thead>
38+
<tr>
39+
<th>Oldest compatible Microsoft.Spark.Worker version</th>
40+
</tr>
41+
</thead>
42+
<tbody align="center">
43+
<tr>
44+
<td>v2.0.0</td>
45+
</tr>
46+
</tbody>
47+
</table>
48+
49+
#### Forward compatibility
50+
51+
The following table describes the oldest version of .NET for Apache Spark release that the current worker is compatible with.
52+
53+
<table>
54+
<thead>
55+
<tr>
56+
<th>Oldest compatible .NET for Apache Spark release version</th>
57+
</tr>
58+
</thead>
59+
<tbody align="center">
60+
<tr>
61+
<td>v2.0.0</td>
62+
</tr>
63+
</tbody>
64+
</table>
65+
66+
### Supported Spark Versions
67+
68+
The following table outlines the supported Spark versions along with the microsoft-spark JAR to use with:
69+
70+
<table>
71+
<thead>
72+
<tr>
73+
<th>Spark Version</th>
74+
<th>microsoft-spark JAR</th>
75+
</tr>
76+
</thead>
77+
<tbody align="center">
78+
<tr>
79+
<td>2.4.0</td>
80+
<td rowspan=7>microsoft-spark-2-4_2.11-2.3.0-rc1.jar</td>
81+
</tr>
82+
<tr>
83+
<td>2.4.1</td>
84+
</tr>
85+
<tr>
86+
<td>2.4.3</td>
87+
</tr>
88+
<tr>
89+
<td>2.4.4</td>
90+
</tr>
91+
<tr>
92+
<td>2.4.5</td>
93+
</tr>
94+
<tr>
95+
<td>2.4.6</td>
96+
</tr>
97+
<tr>
98+
<td>2.4.7</td>
99+
</tr>
100+
<tr>
101+
<td>2.4.2</td>
102+
<td><a href="https://github.com/dotnet/spark/issues/60">Not supported</a></td>
103+
</tr>
104+
<tr>
105+
<td>3.0.0</td>
106+
<td rowspan=3>microsoft-spark-3-0_2.12-2.3.0-rc1.jar</td>
107+
</tr>
108+
<tr>
109+
<td>3.0.1</td>
110+
</tr>
111+
<tr>
112+
<td>3.0.2</td>
113+
</tr>
114+
<tr>
115+
<td>3.1.1</td>
116+
<td rowspan=2>microsoft-spark-3-1_2.12-2.3.0-rc1.jar</td>
117+
</tr>
118+
<tr>
119+
<td>3.1.2</td>
120+
</tr>
121+
<tr>
122+
<td>3.2.0</td>
123+
<td rowspan=2>microsoft-spark-3-2_2.12-2.3.0-rc1.jar</td>
124+
</tr>
125+
<tr>
126+
<td>3.2.1</td>
127+
</tr>
128+
<tr>
129+
<td>3.3.0</td>
130+
<td rowspan=2>microsoft-spark-3-3_2.12-2.3.0-rc1.jar</td>
131+
</tr>
132+
<tr>
133+
<td>3.3.1</td>
134+
</tr>
135+
<tr>
136+
<td>3.3.2</td>
137+
</tr>
138+
<tr>
139+
<td>3.3.3</td>
140+
</tr>
141+
<tr>
142+
<td>3.3.4</td>
143+
</tr>
144+
<tr>
145+
<td>3.4.0</td>
146+
<td rowspan=2>microsoft-spark-3-4_2.12-2.3.0-rc1.jar</td>
147+
</tr>
148+
<tr>
149+
<td>3.4.1</td>
150+
</tr>
151+
<tr>
152+
<td>3.4.2</td>
153+
</tr>
154+
<tr>
155+
<td>3.4.3</td>
156+
</tr>
157+
<tr>
158+
<td>3.4.4</td>
159+
</tr>
160+
<tr>
161+
<td>3.5.0</td>
162+
<td rowspan=2>microsoft-spark-3-5_2.12-2.3.0-rc1.jar</td>
163+
</tr>
164+
<tr>
165+
<td>3.5.1</td>
166+
</tr>
167+
<tr>
168+
<td>3.5.2</td>
169+
</tr>
170+
<tr>
171+
<td>3.5.3</td>
172+
</tr>
173+
<tr>
174+
<td>3.5.4</td>
175+
</tr>
176+
</tbody>
177+
</table>
178+
179+
### Supported Delta Versions
180+
181+
The following table outlines the supported Delta versions along with the Microsoft.Spark.Extensions version to use with:
182+
183+
<table>
184+
<thead>
185+
<tr>
186+
<th>Delta Version</th>
187+
<th>Microsoft.Spark.Extensions.Delta</th>
188+
</tr>
189+
</thead>
190+
<tbody align="center">
191+
<tr>
192+
<td>0.1.0</td>
193+
<td rowspan=11>2.3.0-rc1</td>
194+
</tr>
195+
<tr>
196+
<td>0.2.0</td>
197+
</tr>
198+
<tr>
199+
<td>0.3.0</td>
200+
</tr>
201+
<tr>
202+
<td>0.4.0</td>
203+
</tr>
204+
<tr>
205+
<td>0.5.0</td>
206+
</tr>
207+
<tr>
208+
<td>0.6.0</td>
209+
</tr>
210+
<tr>
211+
<td>0.6.1</td>
212+
</tr>
213+
<tr>
214+
<td>0.7.0</td>
215+
</tr>
216+
<tr>
217+
<td>0.8.0</td>
218+
</tr>
219+
<tr>
220+
<td>1.0.0</td>
221+
</tr>
222+
<tr>
223+
<td>1.1.0</td>
224+
</tr>
225+
<tr>
226+
<td>2.1.0</td>
227+
</tr>
228+
<tr>
229+
<td>2.3.0</td>
230+
</tr>
231+
<tr>
232+
<td>2.4.0</td>
233+
</tr>
234+
<tr>
235+
<td>3.2.0</td>
236+
</tr>
237+
</tbody>
238+
</table>
239+
240+
### Supported Hyperspace Versions
241+
242+
The following table outlines the supported Hyperspace versions along with the Microsoft.Spark.Extensions version to use with:
243+
244+
<table>
245+
<thead>
246+
<tr>
247+
<th>Hyperspace Version</th>
248+
<th>Microsoft.Spark.Extensions.Hyperspace</th>
249+
</tr>
250+
</thead>
251+
<tbody align="center">
252+
<tr>
253+
<td>0.1.0</td>
254+
<td rowspan=4>2.3.0-rc1</td>
255+
</tr>
256+
<tr>
257+
<td>0.2.0</td>
258+
</tr>
259+
<tr>
260+
<td>0.3.0</td>
261+
</tr>
262+
<tr>
263+
<td>0.4.0</td>
264+
</tr>
265+
</tbody>
266+
</table>

0 commit comments

Comments
 (0)