Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,6 @@

## [1.2.22]
test why the tests are failing
## [1.2.21]

* **fix: Enforce minimum version of databricks-sdk (>=0.62.0) for databricks-volumes connector**
Expand Down
1 change: 1 addition & 0 deletions test/integration/connectors/test_jira.py
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@
)


@pytest.mark.skip(reason="Jira test instance unavailable (503 error)")
@pytest.mark.asyncio
@pytest.mark.tags(CONNECTOR_TYPE, SOURCE_TAG, UNCATEGORIZED_TAG)
@requires_env("JIRA_INGEST_USER_EMAIL", "JIRA_INGEST_API_TOKEN")
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -755,36 +755,9 @@
}
}
},
{
"type": "UncategorizedText",
"element_id": "f35698f7adf4541a2bb6fe10e1c47ab8",
"text": "L",
"metadata": {
"filetype": "application/pdf",
"languages": [
"eng"
],
"page_number": 4,
"data_source": {
"url": "s3://utic-dev-tech-fixtures/small-pdf-set/2023-Jan-economic-outlook.pdf",
"version": "c7eed4fc056b089a98f6a3ad9ec9373e",
"record_locator": {
"protocol": "s3",
"remote_file_path": "s3://utic-dev-tech-fixtures/small-pdf-set/",
"metadata": {
"ingest-test": "custom metadata"
}
},
"date_created": "1720544414.0",
"date_modified": "1720544414.0",
"permissions_data": null,
"filesize_bytes": 2215938
}
}
},
{
"type": "NarrativeText",
"element_id": "59ff5bef6f9522074a0347b3fc30d9ba",
"element_id": "cf86df4360039e44a9d36c2156253dca",
"text": "In the United States, growth is projected to fall from 2.0 percent in 2022 to 1.4 percent in 2023 and 1.0 percent in 2024. With growth rebounding in the second half of 2024, growth in 2024 will be faster than in 2023 on a fourth-quarter-over-fourth-quarter basis, as in most advanced",
"metadata": {
"filetype": "application/pdf",
Expand All @@ -811,7 +784,7 @@
},
{
"type": "Footer",
"element_id": "7e03381d8b00018712cf4714181944d5",
"element_id": "8342c28e0cf94f8454bf1c8f4e5b5b8b",
"text": "International Monetary Fund | January 2023",
"metadata": {
"filetype": "application/pdf",
Expand All @@ -838,7 +811,7 @@
},
{
"type": "PageNumber",
"element_id": "e7ad52a3c6a360dcc012d8904b7d68bb",
"element_id": "6ba40e8cf2a64cad3f1484387a1d6e9b",
"text": "3",
"metadata": {
"filetype": "application/pdf",
Expand Down
24 changes: 24 additions & 0 deletions test_e2e/expected-structured-output/s3/Silent-Giant-(1).pdf.json
Original file line number Diff line number Diff line change
Expand Up @@ -383,6 +383,30 @@
}
}
},
{
"type": "PageNumber",
"element_id": "7e1e96312bb39326c5fd3c7e891ce643",
"text": "1",
"metadata": {
"filetype": "application/pdf",
"languages": [
"eng"
],
"page_number": 3,
"data_source": {
"url": "s3://utic-dev-tech-fixtures/small-pdf-set/Silent-Giant-(1).pdf",
"version": "8570bd087066350a84dd8d0ea86f11c6",
"record_locator": {
"protocol": "s3",
"remote_file_path": "s3://utic-dev-tech-fixtures/small-pdf-set/"
},
"date_created": "1676196636.0",
"date_modified": "1676196636.0",
"permissions_data": null,
"filesize_bytes": 6164777
}
}
},
{
"type": "PageNumber",
"element_id": "dc3c4d9a725b0ead89311bb08bd251ae",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -887,9 +887,33 @@
}
}
},
{
"type": "PageNumber",
"element_id": "e754a2849dac122e7d2e05447f0da512",
"text": "4",
"metadata": {
"filetype": "application/pdf",
"languages": [
"eng"
],
"page_number": 6,
"data_source": {
"url": "s3://utic-dev-tech-fixtures/small-pdf-set/recalibrating-risk-report.pdf",
"version": "e690f37ef36368a509d150f373a0bbe0",
"record_locator": {
"protocol": "s3",
"remote_file_path": "s3://utic-dev-tech-fixtures/small-pdf-set/"
},
"date_created": "1676196572.0",
"date_modified": "1676196572.0",
"permissions_data": null,
"filesize_bytes": 806335
}
}
},
{
"type": "Title",
"element_id": "8fd54b8df6f34c7669517fe8f446d39c",
"element_id": "21b4c32e6d360d1d70e59dad888e306d",
"text": "The low-dose question",
"metadata": {
"filetype": "application/pdf",
Expand All @@ -913,7 +937,7 @@
},
{
"type": "NarrativeText",
"element_id": "649d45c4e2dd97d01b6f7f4a0f2652b8",
"element_id": "26e60e901d12cbb5efb851fe945a3f96",
"text": "Since the 1950s, the Linear No-Threshold (LNT) theory has been used to inform regulatory decisions, positing that any dose of radiation, regardless of the amount or the duration over which it is received, poses a risk. Assuming that LNT is correct, we should expect to see that people living in areas of the world where background doses are higher (e.g. India, Iran and northern Europe) have a higher incidence of cancer. However, despite people living in areas of the world where radiation doses are naturally higher than those that would be received in parts of the evacuation zones around Chernobyl and Fukushima Daiichi, there is no evidence that these populations exhibit any negative health effects. Living nearby a nuclear power plant on average exposes the local population to 0.00009mSv/year, which according to LNT would increase the risk of developing cancer by 0.00000045%. After Chernobyl, the average dose to those evacuated was 30mSv, which would theoretically increase the risk of cancer at some point in their lifetime by 0.15% (on top of the average baseline lifetime risk of cancer, which is 39.5% in the USviii, 50% in the UKix).",
"metadata": {
"filetype": "application/pdf",
Expand All @@ -937,7 +961,7 @@
},
{
"type": "NarrativeText",
"element_id": "3d9de2a61836e41e3c1ae8893d5a1722",
"element_id": "31d07d8c2dce96dc1c6daa38f8597ab5",
"text": "Since the 1980s, there has been considerable scientific debate as to whether the LNT theory is valid, following scientific breakthroughs within, for example, radiobiology and medicine. Indeed, the Chernobyl accident helped illuminate some of the issues associated with LNT. Multiplication of the low doses after the accident (many far too low to be of any health concern) with large populations – using the assumptions made by LNT – led to a large number of predicted cancer deaths, which have not, and likely will not materialize. This practice has been heavily criticized for being inappropriate in making risk assessments by UNSCEAR, the International Commission on Radiation Protection and a large number of independent scientists.",
"metadata": {
"filetype": "application/pdf",
Expand All @@ -961,7 +985,7 @@
},
{
"type": "NarrativeText",
"element_id": "d68745fb9259f0ee01b54db35a99ed8d",
"element_id": "4fb06aef292d07a36339c830eb23c8b5",
"text": "Determining the precise risk (or lack thereof) of the extremely small radiation doses associated with the routine operations of nuclear power plants, the disposal of nuclear waste or even extremely rare nuclear accidents is a purely academic exercise, that tries to determine whether the risk is extremely low, too small to detect, or non- existent. The risks of low-level radiation pale in comparison to other societal risks such as obesity, smoking, and air pollution.",
"metadata": {
"filetype": "application/pdf",
Expand All @@ -985,7 +1009,7 @@
},
{
"type": "NarrativeText",
"element_id": "629dfc4049633d8d9662948622e8d7b8",
"element_id": "1d9fdadf74d73e63be2e683b0a73d86d",
"text": "By looking at radiation risks in isolation, we prolong the over-regulation of radiation in nuclear plants, driving up costs, whilst not delivering any additional health benefits, in turn incentivising the use of more harmful energy sources. A recalibration is required, and this can only done by ensuring a holistic approach to risk is taken.",
"metadata": {
"filetype": "application/pdf",
Expand All @@ -1009,7 +1033,7 @@
},
{
"type": "Image",
"element_id": "8f8ae3b8a2b83fbdd13bc12bf68aa108",
"element_id": "32259f82b294edd5dd1868734673c0a1",
"text": "U ER LE E » L",
"metadata": {
"filetype": "application/pdf",
Expand Down
2 changes: 1 addition & 1 deletion unstructured_ingest/__version__.py
Original file line number Diff line number Diff line change
@@ -1 +1 @@
__version__ = "1.2.21" # pragma: no cover
__version__ = "1.2.22" # pragma: no cover