Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
56 changes: 56 additions & 0 deletions sdk/cosmos/azure-cosmos-spark_4-1_2-13/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,56 @@
## Release History

### 4.47.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes

#### Bugs Fixed

#### Other Changes

### 4.46.0 (2026-03-27)

#### Bugs Fixed
* Fixed an issue where creating containers with hierarchical partition keys (multi-hash) through the Spark catalog on the AAD path would fail. - See [PR 48548](https://github.com/Azure/azure-sdk-for-java/pull/48548)

### 4.45.0 (2026-03-13)

#### Features Added
* Added `vectorEmbeddingPolicy` support in Spark catalog `TBLPROPERTIES` for creating vector-search-enabled containers. - See [PR 48349](https://github.com/Azure/azure-sdk-for-java/pull/48349)

### 4.44.2 (2026-03-05)

#### Other Changes
* Changed azure-resourcemanager-cosmos usage to a pinned version which is deployed across all public and non-public clouds - [PR 48268](https://github.com/Azure/azure-sdk-for-java/pull/48268)

### 4.44.1 (2026-03-03)

#### Other Changes
* Reduced noisy warning logs in Gateway mode - [PR 48189](https://github.com/Azure/azure-sdk-for-java/pull/48189)

### 4.44.0 (2026-02-27)

#### Features Added
* Added config entry `spark.cosmos.account.azureEnvironment.management.scope` to allow specifying the Entra ID scope/audience to be used when retrieving tokens to authenticate against the ARM/management endpoint of non-public clouds. - See [PR 48137](https://github.com/Azure/azure-sdk-for-java/pull/48137)

### 4.43.1 (2026-02-25)

#### Bugs Fixed
* Fixed an issue where `TransientIOErrorsRetryingIterator` would trigger extra query during retries and on close. - See [PR 47996](https://github.com/Azure/azure-sdk-for-java/pull/47996)

#### Other Changes
* Added status code history in `BulkWriterNoProgressException` error message. - See [PR 48022](https://github.com/Azure/azure-sdk-for-java/pull/48022)
* Reduced the log noise level for frequent transient errors - for example throttling - in Gateway mode - [PR 48112](https://github.com/Azure/azure-sdk-for-java/pull/48112)

### 4.43.0 (2026-02-10)

#### Features Added
* Initial release of Spark 4.0 connector with Scala 2.13 support
* Added transactional batch support. See [PR 47478](https://github.com/Azure/azure-sdk-for-java/pull/47478) and [PR 47697](https://github.com/Azure/azure-sdk-for-java/pull/47697) and [47803](https://github.com/Azure/azure-sdk-for-java/pull/47803)
* Added support for throughput bucket. - See [47856](https://github.com/Azure/azure-sdk-for-java/pull/47856)

#### Other Changes

### NOTE: See CHANGELOG.md in 3.3, 3.4, and 3.5 projects for changes in prior Spark versions
84 changes: 84 additions & 0 deletions sdk/cosmos/azure-cosmos-spark_4-1_2-13/CONTRIBUTING.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,84 @@
# Contributing
This instruction is guideline for building and code contribution.

## Prerequisites
- JDK 17 or above (Spark 4.0 requires Java 17+)
- [Maven](https://maven.apache.org/) 3.0 and above

## Build from source
To build the project, run maven commands.

```bash
git clone https://github.com/Azure/azure-sdk-for-java.git
cd sdk/cosmos/azure-cosmos-spark_4-0_2-13
mvn clean install
```

## Test
There are integration tests on azure and on emulator to trigger integration test execution
against Azure Cosmos DB and against
[Azure Cosmos DB Emulator](https://docs.microsoft.com/azure/cosmos-db/local-emulator), you need to
follow the link to set up emulator before test execution.

- Run unit tests
```bash
mvn clean install -Dgpg.skip
```

- Run integration tests
- on Azure
> **NOTE** Please note that integration test against Azure requires Azure Cosmos DB Document
API and will automatically create a Cosmos database in your Azure subscription, then there
will be **Azure usage fee.**

Integration tests will require a Azure Subscription. If you don't already have an Azure
subscription, you can activate your
[MSDN subscriber benefits](https://azure.microsoft.com/pricing/member-offers/msdn-benefits-details/)
or sign up for a [free Azure account](https://azure.microsoft.com/free/).

1. Create an Azure Cosmos DB on Azure.
- Go to [Azure portal](https://portal.azure.com/) and click +New.
- Click Databases, and then click Azure Cosmos DB to create your database.
- Navigate to the database you have created, and click Access keys and copy your
URI and access keys for your database.

2. Set environment variables ACCOUNT_HOST, ACCOUNT_KEY and SECONDARY_ACCOUNT_KEY, where value
of them are Cosmos account URI, primary key and secondary key.

So set the
second group environment variables NEW_ACCOUNT_HOST, NEW_ACCOUNT_KEY and
NEW_SECONDARY_ACCOUNT_KEY, the two group environment variables can be same.
3. Run maven command with `integration-test-azure` profile.

```bash
set ACCOUNT_HOST=your-cosmos-account-uri
set ACCOUNT_KEY=your-cosmos-account-primary-key
set SECONDARY_ACCOUNT_KEY=your-cosmos-account-secondary-key

set NEW_ACCOUNT_HOST=your-cosmos-account-uri
set NEW_ACCOUNT_KEY=your-cosmos-account-primary-key
set NEW_SECONDARY_ACCOUNT_KEY=your-cosmos-account-secondary-key
mvnw -P integration-test-azure clean install
```

- on Emulator

Setup Azure Cosmos DB Emulator by following
[this instruction](https://docs.microsoft.com/azure/cosmos-db/local-emulator), and set
associated environment variables. Then run test with:
```bash
mvnw -P integration-test-emulator install
```


- Skip tests execution
```bash
mvn clean install -Dgpg.skip -DskipTests
```

## Version management
Developing version naming convention is like `0.1.2-beta.1`. Release version naming convention is like `0.1.2`.

## Contribute to code
Contribution is welcome. Please follow
[this instruction](https://github.com/Azure/azure-sdk-for-java/blob/main/CONTRIBUTING.md) to contribute code.
Loading