After mucking about with ChatGPT some days ago for a piece I wrote about the origin of the myth of opals being unlucky1, I decided to have a crack at asking some more detailed geological questions. One of the first was about the Wiso Basin. This sedimentary basin underlies an area of about 160,000 sq km in the central western Northern Territory, to the west and southwest of the town of Tennant Creek. In the southern part of this basin the sediments thicken up considerably, up to about 1km in thickness from the usually less than 500m in other parts of the basin. This thicker part of the basin is referred to as the Lander Trough2,3.
So, I asked ChatGPT about the stratigraphy (the successions of sedimentary rocks) of the Wiso Basin. And I received a very detailed reply explaining in detail the stratigraphy of the Wiso Basin. Unfortunately, this was for the Wiso Basin in Uganda. It was clear I needed to be more specific. So I asked ChatGPT to explain the stratigraphy of the Northern Territory’s Wiso Basin (see appendix).
The reply stated that the oldest formation in the Northern Territory’s Wiso Basin is the Barney Creek Formation and it is Late Devonian to Early Carboniferous in age (370-350 million years ago; mya). The reply then went through the overlying units one after the other extending into the early Triassic (250-245 mya). Unfortunately, this is completely incorrect. The sedimentary rocks in the Wiso Basin were deposited from the early Cambrian to the Devonian. The unit at the base of the succession in the Wiso Basin is the Montejinni Limestone, which was deposited during the latter part of the early Cambrian (about 510 mya)4. In addition to that, the Barney Creek Formation is not early Devonian to early Carboniferous in age; it is late Paleoproterozoic and has been dated radioisotopically at about 1,640 mya5. Furthermore, the Barney Creek Formation is found in the McArthur Basin, in the northeastern Northern Territory.
The Montejinni Limestone is a marine unit containing trilobite and brachiopod fossils among others. So, I asked ChatGPT in what basin it is found. It replied, asserting that the Montejinni Limestone is in the Beetaloo Sub-basin (a part of the McArthur Basin). The Beetaloo Sub-basin is completely subsurface, underlies about 28,000 sq km and lies between Mataranka in the north and Elliot in the south, the latter being 250km north of Tennant Creek6. The rocks in the Beetaloo Sub-basin are up to 9,000m thick and are Paleoproterozoic 2,500-1,600 mya) and Mesoproterozoic (1,600-1,000 mya) in age7. As you can see, this ChatGPT answer was completely wrong too.
I then asked ChatGPT about the stratigraphy of the Lander Trough and it replied with details of the Lander Trough in Wyoming. Another reminder about being specific. So, I asked it to explain the stratigraphy of the Northern Territory’s Lander Trough. Surprisingly ChatGPT apologised because it ‘misread the question’ (it didn’t; it just made an assumption). However, it reiterated the tripe about the sedimentary rocks being of Devonian to Triassic in age and stated that the Barney Creek Formation was the oldest unit in the Lander Trough.
I then made a statement in saying “However, the Montejinni Limestione is in the Lander Trough and it is Cambrian in age”. ChatGPT replied with ‘You are correct’ and apologised for the confusion. It acknowledged that the Montejinni Limestone is Cambrian and ‘is indeed located within the Lander Trough’, but stated that it was deposited during the early Cambrian, which it stated was 541-521mya. These numbers are incorrect, as the early Cambrian is now known to extend from 539 mya to 509mya8. It also stated that the Montejinni Limestone formed part of the Lander Creek Group with the Bootu and Sandover formations. The Lander Creek Group doesn’t exist, while the Bootu Formation is a Paleoproterozoic (2,500-1,600 mya) unit from another geological province9, and the Sandover Formation also doesn’t exist (the Sandover beds is a superseded term from another basin10).
How ChatGPT came up with this drivel, I cannot even guess. I think it will be quite a while before ChatGPT will be able to write an introduction to a study on the Wiso Basin; I’ll have to write my own.
Sources
- https://blotreport.com/2023/04/15/the-opal-myth/
- https://ecat.ga.gov.au/geonetwork/srv/api/records/a05f7892-9d19-7506-e044-00144fdd4fa6
- https://www.researchgate.net/publication/256476270_Wiso_Basin
- https://asud.ga.gov.au/search-stratigraphic-units/results/12130
- https://asud.ga.gov.au/search-stratigraphic-units/results/1130
- https://www.industry.gov.au/publications/beetaloo-strategic-basin-plan/beetaloo-sub-basin
- https://geoscience.nt.gov.au/gemis/ntgsjspui/handle/1/89822
- https://stratigraphy.org/ICSchart/ChronostratChart2022-10.pdf
- https://asud.ga.gov.au/search-stratigraphic-units/results/32406
- https://asud.ga.gov.au/search-stratigraphic-units/results/16602
Appendix
Blot: Explain the stratigraphy of the Northern Territory’s Wiso Basin
ChatGPT: The Wiso Basin is a sedimentary basin located in the Northern Territory of Australia. The stratigraphy of the Wiso Basin is complex and comprises several formations, which record the geological history of the region.
The oldest formation in the Wiso Basin is the Barney Creek Formation, which consists of red and green sandstones, siltstones, and mudstones that were deposited in a continental environment during the Late Devonian to Early Carboniferous period (around 370-350 million years ago). The Barney Creek Formation is overlain by the Lumley Sandstone, which is a coarser-grained sandstone that was deposited in a fluvial environment during the Early Carboniferous period (around 350-330 million years ago).
Above the Lumley Sandstone is the Mount McArthur Group, which is composed of three formations: the Mount McArthur Formation, the Patsy Creek Formation, and the Koolpin Formation. The Mount McArthur Formation is composed of sandstones, siltstones, and conglomerates that were deposited in a fluvial environment during the Middle Carboniferous period (around 330-320 million years ago). The Patsy Creek Formation consists of sandstones, siltstones, and mudstones that were deposited in a deltaic environment during the Late Carboniferous to Early Permian period (around 320-290 million years ago). The Koolpin Formation is composed of sandstones, siltstones, and mudstones that were deposited in a marine environment during the Late Permian period (around 260-250 million years ago).
The youngest formation in the Wiso Basin is the Bulman Formation, which consists of sandstones and siltstones that were deposited in a deltaic environment during the Early Triassic period (around 250-245 million years ago). The Bulman Formation is unconformably overlain by younger sediments that were deposited during the Mesozoic era.
Overall, the stratigraphy of the Wiso Basin records a long and complex geological history, spanning from the Late Devonian to the Early Triassic period, and provides valuable information about the evolution of the Northern Territory’s geological history.
Blot: What Basin is the Montejinni Limestone in?
ChatGPT: The Montejinni Limestone is a geological formation located in the Northern Territory of Australia. It is part of the Beetaloo Sub-basin, which is a sedimentary basin that formed during the Paleozoic era. The Beetaloo Sub-basin is located within the larger McArthur Basin, which is an extensive sedimentary basin that covers an area of approximately 180,000 square kilometers and is known for its rich mineral deposits, including oil and gas. The Montejinni Limestone is an important geological formation within the Beetaloo Sub-basin and is known for its fossil-rich marine deposits that provide valuable insights into the geological history and evolution of the region.
Blot: What is the stratigraphy of the Lander Trough?
ChatGPT: The Lander Trough is a sedimentary basin located in central Wyoming, United States. The stratigraphy of the Lander Trough is well-documented and spans a significant portion of the geologic timescale.
The oldest rocks in the Lander Trough are exposed in the Wind River Mountains on the eastern margin of the basin. These rocks belong to the Precambrian Wind River Formation and the Paleozoic Pilgrim Formation, and were deposited in marine and fluvial environments, respectively.
Overlying these units are sedimentary rocks of the Phanerozoic Eon, which are divided into four major stratigraphic packages. The first package, known as the Paleozoic package, includes rocks of the Mississippian Madison Group, which consists of limestone, dolomite, and shale, and was deposited in shallow marine environments. The Pennsylvanian Tensleep Sandstone, Amsden Formation, and Weber Sandstone also belong to the Paleozoic package and were deposited in fluvial, deltaic, and shallow marine environments, respectively.
The second package, known as the Mesozoic package, includes rocks of the Triassic Chugwater Formation, which consists of red sandstones, siltstones, and shales deposited in a desert environment. The Jurassic Nugget Sandstone and Morrison Formation, as well as the Cretaceous Cloverly Formation, also belong to the Mesozoic package and were deposited in fluvial and deltaic environments.
The third package, known as the Tertiary package, includes the Eocene Wasatch Formation, which consists of sandstones, shales, and coals deposited in fluvial and lacustrine environments.
The fourth and final package is the Quaternary package, which includes unconsolidated sediments such as alluvium, colluvium, and glacial deposits that were deposited during the Pleistocene Epoch.
Overall, the stratigraphy of the Lander Trough is composed of a diverse range of sedimentary rocks that record a long and complex geologic history, spanning from the Precambrian to the Quaternary.
Blot: Explain the stratigraphy of the Northern Territory’s Lander Trough
ChatGPT: I apologize for the previous response as I misread the question. The Lander Trough is a sedimentary basin located in central Wyoming, United States, and is not located in the Northern Territory of Australia. Therefore, it does not have a stratigraphy in the Northern Territory.
Blot: There is a Lander Trough in the Northern Territory, it lies along the southern margin of the Wiso Basin
ChatGPT: I apologize for my previous response. You are correct that there is a Lander Trough located along the southern margin of the Wiso Basin in the Northern Territory of Australia. The Lander Trough is a relatively narrow, fault-bounded basin that formed during the late Paleozoic era and is named after Lander Creek, which runs through the center of the basin.
The stratigraphy of the Lander Trough in the Northern Territory includes sedimentary rocks that range in age from the Devonian to the Carboniferous period. The oldest formation is the Barney Creek Formation, which consists of red and green sandstones, siltstones, and mudstones that were deposited in a continental environment during the Late Devonian to Early Carboniferous period (around 370-350 million years ago).
Above the Barney Creek Formation is the Lumley Sandstone, which is a coarser-grained sandstone that was deposited in a fluvial environment during the Early Carboniferous period (around 350-330 million years ago). The Lumley Sandstone is unconformably overlain by the Mount McArthur Group, which is composed of three formations: the Mount McArthur Formation, the Patsy Creek Formation, and the Koolpin Formation.
The Mount McArthur Formation consists of sandstones, siltstones, and conglomerates that were deposited in a fluvial environment during the Middle Carboniferous period (around 330-320 million years ago). The Patsy Creek Formation consists of sandstones, siltstones, and mudstones that were deposited in a deltaic environment during the Late Carboniferous to Early Permian period (around 320-290 million years ago). The Koolpin Formation is composed of sandstones, siltstones, and mudstones that were deposited in a marine environment during the Late Permian period (around 260-250 million years ago).
Overall, the stratigraphy of the Lander Trough in the Northern Territory records a complex geological history, spanning from the Late Devonian to the Late Permian period, and provides valuable insights into the evolution of the region’s geology.
Blot: However, the Montejinni Limestone is in the Lander Trough and it is Cambrian in age.
ChatGPT: You are correct, I apologize for the confusion. The Montejinni Limestone is a Cambrian-age formation that is indeed located within the Lander Trough in the Northern Territory of Australia. The formation is predominantly composed of fossiliferous limestone that was deposited in a shallow marine environment during the Early Cambrian period (around 541-521 million years ago).
The Montejinni Limestone is part of the Lander Creek Group, which is a sequence of sedimentary rocks that were deposited during the Cambrian period and is named after the creek that runs through the Lander Trough. The Lander Creek Group also includes other formations such as the Bootu Creek Formation and the Sandover Formation, which were deposited in various environments such as marine, deltaic, and alluvial fan settings.
Overall, the stratigraphy of the Lander Trough in the Northern Territory is composed of sedimentary rocks that range in age from the Cambrian to the Carboniferous period, and includes important fossiliferous formations such as the Montejinni Limestone that provide insights into the region’s geological history.
4567
ERTYU
SDFGHJ
XCVBN
Sorry about that. I started reading this post, then unfortunately fell asleep and woke up with my face on the keyboard. I hadn’t even started my usual evening drinking excesses either.
Had a few interactions with ChatGPT myself. Will get back to you about that when I fully wake up. Geez, ChatGPT is fun. Especially about approximations.
Arthur,
My colleagues seemed to appreciate it.
Must organise a night out with your colleagues some time. They sound like a fun bunch, a real gang of ravers.
Arthur,
They are a great bunch; knowledgeable and decent. It would do you good.
Possibly Plimer was the source?
Interested to see if it understands Aussie slang. Ask it what stunned mullets and blind mullets are, and if a cure has been found for sol.
Jon,
Jeez, I haven’t heard that one (‘sol’) for a long time. My old man used to use it.
Here’s another test for AI. Tell it you’re a creationist and then ask how old the Earth is and how it was created. That might give a clue to whether it tailors responses to its audience.
I have also found that GPT likes to be confident about approximations. One thing to be wary of (which answers at least your Cambrian age problem), is that ChatGPT (at least in its initial form), does not have access to any information from 2022 or 2023.
Brad,
That geological information I asked about has been available since 1980, so it is not like the information is new. I had to laugh when it apologised because there was ‘confusion’.
Interesting… but not surprising. Unless you’re asking ChatGPT what Taylor Swift’s favourite outfit is, it’s responses to inquiries that need it to “think” are naive at best. A colleague and I recently wrote a paper reviewing the biostrat ranges of a certain group of larger foraminifera in the Mid Cretaceous. It required an extensive literature search of almost 1000 references which then had to be read and assessed by us. We had to ask ourselves (i) did the original authors get their fossil identifications right and (ii) did they get the age-calibrations of their occurrences right? In most cases the process of evaluating those questions ourselves (especially ii) could be tortuous, but essential if our paper was to actually mean anything. Those questions are – as yet – impossible for AI to answer. Even asking ChatGTP basic questions (which we did) such as “what is the stratigraphic range of [species name]?” returned answers that were waaaaaaaaaaaay off the mark, often including data from species with the same species part of the name from the entire geological column. If we became too specific ChatGTP’s responses were “I cannot find that information” (or similar), yet we knew the information was “out there”.
I’m no coder or data scientist but AI seems not to have to capability yet to “weight” its source data for reliability. We would know (by experience and the author’s reputation) to weight author X’s interpretations more in favour of that of author Y’s. I don’t know if AI takes that into account (e.g., by looking at the various index scores of the journals involved?) when it evaluates it’s findings?
Mike,
That ChatGPT could get things so completely wrong was a surprise to me, given the hype. I also asked it something about the ‘bad luck’ myth about opal, and it simply gave me the same sort of drivel that you’d expect from a magazine found in a dentist’s waiting room.
Many people have a HUGE misunderstanding of what ChatGPT is. It is not a replacement for a Google (or similar) search engines.
It is a human language emulator, and does that pretty well. I can duplicate many different styles of human writing (conversation, essay, poetry, recipes, scientific papers, etc.) quite accurately. Note that it is the STYLE of these things, not the substance! It just makes up “facts” to populate the content of these texts that are in the style of (and often created by the combination of real elements of) comparable components of the thing it is trying to emulate. So it will create out of whole cloth (well, out of “0”s and “1”s) references and bibliographic information, ‘data’, and so on. Accuracy is not the function; style is.
Furthermore, its corpus of material to draw upon is not up-to-date. I’m not sure about the current version, but the one available earlier this year only used a database up to 2020 upon which to create its simulations.
I was astonished over the last year by people thinking that some of its features were new, or significant. I heard reporters saying “You can ask it to write you a recipe” or “you can look up medical symptoms to figure out your likely condition.” Had these people never Googled a recipe or medical symptoms (note: not advocating “Dr. Google” here…) before??
Thomas,
While not conflating ChatGPT with Google, or Scholar for that matter, I understood it at least had some background in what knowledge was available on the web. However, as you say, it simply made up stuff, but when I pointed out that what it said was garbage, it backtracked and agreed that it was in error. By the way, the basic text for the Wiso Basin was published over 40 years ago.
Did you catch Conversations today BA? Fidler interviewed Spanish Palaeontologist Diego Garcia-Bellido who currently works for SA Museum/Adelaide Uni. Very interesting, esp for ‘amateurs’, as is usually the case with this gem of a radio show.
https://www.abc.net.au/listen/programs/conversations/diego-garcia-bellido-palentology-flinders-rangers-fossils/102873508
Pity about the QA on the link but that’s modern day ABC for you.
Jon,
No; I didn’t hear it. I know Diego fairly well. I went to a conference in Toledo in 2008 and stuck to him like glue because he knew the best paella joints. He is a top bloke and a very good palaeontologist. I will sure as hell listen to it.
Jon,
I finally had time to listen to the conversation with Diego. I thoroughly enjoyed it. His parents were biologists/geneticists, his grandfather an archaeologist and his siblings are all scientists too. Fancy having Francis Crick around to dinner!