Skip to content

Commit f5f2ac9

Browse files
update README
1 parent 2bcae6a commit f5f2ac9

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -50,6 +50,7 @@ spark.readStream.format("fake").load().writeStream.format("console").start()
5050
| [StockDataSource](pyspark_datasources/stock.py) | `stock` | Batch Read | Read stock data from Alpha Vantage | None | `pip install pyspark-data-sources`<br/>`spark.read.format("stock").option("symbols", "AAPL,GOOGL").option("api_key", "key").load()` |
5151
| **Batch Write** | | | | | |
5252
| [LanceSink](pyspark_datasources/lance.py) | `lance` | Batch Write | Write data in Lance format | `lance` | `pip install pyspark-data-sources[lance]`<br/>`df.write.format("lance").mode("append").save("/tmp/lance_data")` |
53+
| [SimpleJsonDataSource](pyspark_datasources/simplejson.py) | `simplejson` | Batch Write | Write JSON data to Databricks DBFS | `databricks-sdk` | `pip install pyspark-data-sources[simplejson]`<br/>`df.write.format("simplejson").save("/path/to/output")` |
5354
| **Streaming Read** | | | | | |
5455
| [OpenSkyDataSource](pyspark_datasources/opensky.py) | `opensky` | Streaming Read | Read from OpenSky Network. | None | `pip install pyspark-data-sources`<br/>`spark.readStream.format("opensky").option("region", "EUROPE").load()` |
5556
| [WeatherDataSource](pyspark_datasources/weather.py) | `weather` | Streaming Read | Fetch weather data from tomorrow.io | None | `pip install pyspark-data-sources`<br/>`spark.readStream.format("weather").option("locations", "[(37.7749, -122.4194)]").option("apikey", "key").load()` |

0 commit comments

Comments
 (0)