Showing posts with label database. Show all posts
Showing posts with label database. Show all posts

Wednesday, June 29, 2022

Digital Antiquities Databases; Their Visualization and The Mycenaean Atlas Project Digital Atlas

Several of the common digital antiquities databases have very poor or non-existent visualization tools.  Their focus is showing you individual sites on a map and with precious little other support.  The least satisfactory in this regard is Arthur deGraauw's Harbors project.  Dr. deGraauw is an outstanding expert in the field of harbor research; he freely and generously makes his data available to everyone.  This data is, however, in the form of a spreadsheet (computer types refer to this as a 'flat file') and no map visualization is possible on his site.  The remainder among these various DBs provide a dedicated page for each site along with minimal, mostly useless information about it, but without any larger visualization.  The best user interface among these databases is Vici which provides a visualization map for each site and shows you the context.  I do notice, though, that when I use Vici that there is often no site description or indication of the site's significance.   Here's an example: this shows Neftina on Lemnos which appears to be a quarry although we are not told this:



Vici is actually pretty good and contains nearly everything you want in map visualization.  Vici also  provides context in the form of other near-by sites.  The zoom-level is user controlled and jumping to another site does not require you to go back into outer space before zooming in again.  

Multiple Databases

When research involves the several popular databases dealing with antiquity it necessitates running back and forth from one window to the next and trying to put all this data into context.
   
There must be a better way.

What do we require when visualizing geographic data from antiquity?  Ideally we should be able to see all the data simultaneously on one map so the databases are inter-comparable.  Is the site coverage around Peristeria in Messenia significantly different between Pleiades and Vici?   To answer this question you need these two DBs on the same map so that they can be compared.  And each site on this combo-map should link back to the dedicated page which contains more info about that one site.  The map itself should be interactive. You should be able to click/tap on it and have it redraw centered on where you've clicked/tapped; restoring the data context at the same time.

 We're talking about a lot of data here.  The M.A.P. Digital Atlas can display abut 100,000 data points.  So when the user looks for one site (Chania on Crete, say) how many surrounding DB sites should be drawn automatically? 

Dumping the entire DB is too much.   It's time consuming.  Most of the DB would not be of concern to the user.  And the program response would take a significant hit.

Showing just the individual site is too little.  (Pleiades is worst in this regard.  P. annoyingly zooms in from outer space for every site search and it never shows any context.) 

Pleiades: Searching for Kydonia.
Phase 1: Outer Space!


Topostext shows the context around a sought-for site but it also forces the user back into outer space in most instances.)

The Mycenaean Atlas Project Digital Atlas chooses a middle way.  What is needed is enough context so that the user can work for an extended period on that specific level (Zoom levels 12-18 in most instances).  The Digital Atlas creates and  populates a frame which is about 1/5 of a degree in lat and lon.  In practice this seems to afford adequate space for investigating the immediate surroundings with little or no detectable drawing time.  When the user clicks/taps on the map it is redrawn with the new frame centered at the click.  The new frame is filled in from whatever data sets the user has chosen.

Part of Lemnos in the Mycenaean Atlas Project Digital Atlas
Features (red F paddles), M.A.P. sites (Bronze Age) in blue and Trismegistos sites are displayed

In any solution all the data sets should be visible.  In practice, even when limited by a frame, this can produce a great deal of confusing data overlay.  The user should, therefore, be able to  pick and choose among the various sets - showing all, or none, or some combination.  One wants to be able to see what Pleiades has covered as opposed to what Vici has covered, for example.  The M.A.P. Digital Atlas features a pull-down menu which allows the user to select as many/few database layers as desired.

The Lemnos map (detail)
Layer Menu visible along with 'spotter' map

In sum, then, the Digital Atlas from the Mycenaean Atlas Project adheres to the following design features:
  1. Supports visualization for the following DBs: DARE, deGraauw's Harbors Project, Mycenaean Atlas Project (with features), Pleiades, Topostext, Trismegistos, VICI
  2. Displays these databases in a frame that is 0.18° 'square'.
  3. Differential selection among the seven data sets
  4. Persistent zoom level (user-controlled zoom) (The user is never catapulted into outer space against his/her will)
  5. User-controlled redraw of the frame by clicking anywhere on the map
  6. Links from each DB icon to the relevant details page (Pleiades, Topostext etc., even deGraauw's Harbors).
  7. User-selectable map sheet backgrounds
The result is a quick and easy way to examine coverage for a place (e.g. Siteia on Crete) among the several databases.

I have said that each icon has links to a site details page.  Pleiades icon to Pleiades site, Topostext icon to Topostext site, etc.  The only exception is Dr. deGraauw's Harbors project.  There are no detail pages on his site for individual harbors and so I created a harbor details page for him.  Those pages faithfully reflect HIS data.  Here's an example:

Sample detail page for Arthur deGraauw's Harbor data.
This is Neftina on Lemnos

Looking at this I see that this page should have a 'spotter' map like the Digital Atlas.  Always something more to do.

Databases aren't just created for random and unstatable purposes.  They are created for reasons.  These reasons take their form in the software that is written to execute over them.  One thing that is absolutely essential is careful thinking about the user interface and visualization.  With awkward or non-existent visualization tools the database is incapable of effectively displaying itself.


 

Thursday, December 7, 2017

Major Changes on Helladic.Info (12/06/17)





Previously this website supported a miscellany of search methods.  There were separate methods for place-name search, place key search, and regional site search.  In this new release these methods have been combined into a generalized search method which now appears on all pages.  You can search for all the things you could formerly search for.  In addition any text string can be searched on and every instance of that string in the database will be returned with a link to the site page or feature page on which that string appears.  For example, strings such as 'vasilios', 'Simpson', 'Banou', etc. can now be searched on.

There is a new Feature Key page which gives basic information about all features (which are non Bronze Age things such as bridges, towns, churches, etc.).  Features can be searched for by using their feature key (which always begins with an 'F'), e.g. ‘F346’.

Sites can now be searched on by using the place key identifier (which always begins with 'C'), e.gg. 'C100', 'C5140'.

Regional site search now functions differently.  When you input a regional name such as ‘Laconia’, for example, you will see a list of all the sites in Laconia along with every other use of the term ‘Laconia’ on the web site.


There is a new Search Results page.

A new Database (MAP_Rev_0.045__12_06_17) has been delivered.  This new DB supports the enhanced search facility.

A change of this magnitude usually turns up glitches.  Please report problems to 

bobconsoli "at" gmail.com

An enhanced site usage section for the new changes is currently being prepared.

Sunday, November 12, 2017

Delivery of Database 43 and a discussion of how to handle ceramic horizon names in searches.




So, I’m sure that my readers are aware that the dating of Mycenaean (and other) sites is based, usually, on the types, shapes, and decoration of ceramic objects that are found on site.  These ceramic horizons are the familiar ‘Middle Helladic’, ‘Late Helladic’, etc. and their innumerable subdivisions.  For example ‘Late Helladic’ is divided into ‘Late Helladic I’, ‘Late Helladic II’, and ‘Late Helladic III’.  ‘Late Helladic III’ is further subdivided into phases A, B, and C.  These can, in turn, be further subdivided.

The upshot of all this is that sites are dated to several very different degrees of precision.  Site A may be dated as ‘LH’ while Site B, perhaps nearby and in reality built at the same time, may be dated more precisely as ‘LHIIIA2’ because a definitely identifiable sherd of that period was found there.  As far as we know the first site may have been built/occupied at any time over some time span of 500 years while the second site is more securely dated to within 50 years.

How do we compare these two sites on the Mycenaean Atlas Project site?    If the user specifies ‘LH’ as a dating criterion then we feel that more should be returned than just those sites which are vaguely dated as ‘LH’.  That criterion should return all sites that are ‘LH’, ‘LHI’, ‘LHII’, ‘LHIII’ and all the further subdivisions all the way down the tree.

Up until now that hasn’t happened on this site.  When a user formerly specified ‘LH’ or ‘MH’ what was returned was only those sites given those vague time scopes.  ‘LH’ as a search criterion returned only ‘LH’ not ‘LH’, ‘LHI’, ‘LHII’, etc.

Now I’ve implemented that common-sense orientation.  Users requesting ‘MH’ get ‘MH’, ‘MHI’, and ‘MHII’.  A request for ‘LH’ returns all the sites with at least one date starting ‘LH-‘, i.e., ‘LHI’, ‘LHII’, ‘LHIII’, ‘LHIA’, ‘LHIB’, etc., etc.  And the same goes for all the other sites which have dates that are, themselves, further subdividable.

All this by way of announcing a new delivery of database and software. 
The database is MAP_Rev_0.043__11_9_17_Test.   Among other things it provides a new table to support the software change outline above.   Many minor changes have been made to the site data.  The most important is that Privitera [2013] is now integrated with sites for Attica.

New software for map creation and .kml/.csv generation has also been delivered.  The major software change is as I explained above.   It also fixes a distressing fact that the numbers of results from both map creation and .kml/.csv creation tended to be different.  The queries that support those things have now been harmonized.


Do you have a suggestion for the Mycenaean Atlas Project?  Let us know in the letters section at the end of this post.  Or write to me at bobconsoli ‘at’ gmail.com


Bibliography

Privitera [2013]:  Privitera, Santo.  Principi, Pelasgi, e pescatori: L'Attica nella Tarda Eta del Bronzo.  Paestum: Pandemos. 2013.












Monday, October 23, 2017

Database Release Rev 0.042 for Helladic.Info


Today the website helladic.info has received a new database: MAP_Rev_0.042__10_23_17_Test

This DB fixes many minor errors and finishes the integration of Banou [1996].  It also adds the following Mycenaean find sites:

Key           Name                                          Lat                     Lon                    Region

C5043 Aetos: Skala 39.572055 20.357397 Epirus
C5044 Anthochori: Agioi Apostoloi 39.738985 21.12192 Epirus
C5045 Hydas/Selimiye 36.704264 28.094181 Caria
C5046 Kadikalesi 37.791729 27.270687 Ionia
C5047 Çine Tepecik Höyük 37.609346 28.01202 Caria
C5048 Perge 36.961157 30.854204 Pamphylia
C5049 Kilisitepe 36.502329 33.553426 Cilicia
C5050 Kinet Höyük 36.853609 36.157014 Cilicia
C5051 Tell Tayinat 36.248157 36.375783 Seleucia
C5052 Ilioupolis/Kara 37.930173 23.762682 Attica
C5053 Munichia: Temple of Artemis 37.939834 23.655682 Attica
C5054 Merenda: Mycenaean Cemetery 37.882438 23.969516 Attica
C5055 Glyka Nera - Fouresi 38.0067 23.849567 Attica
C5056 Nekyomanteion 39.236154 20.534308 Epirus
C5057 Skoura: Melathria: Cem 37.038056 22.498089 Laconia
C5058 Ayios Vasileios 2 36.98242 22.482425 Laconia
C5059 Chrysapha: Panagia Chrysafio. 37.078249 22.529832 Laconia
C5060 Chrysapha: Palaikastro 37.06787 22.53428 Laconia
C5061 Phoiniki (Ntouka Rachis Phoi. 36.715509 22.9271 Laconia
C5062 Panaghia: Cem 36.484393 22.939592 Laconia
C5063 Ayios Yeoryios: Cave 36.537201 22.993183 Laconia
C5064 Aigies 36.777244 22.51641 Laconia
C5065 Aphissou 37.078788 22.452966 Laconia

Bibliography

Banou [1996]:   Banou, Emilia. Beitrag zum Studium Lakoniens in der mykenischen Zeit, Albert-Ludwigs-Universität zu Freiburg. 1996

Saturday, October 7, 2017

Database Update MAP_Rev_0.040__10_06_17_Test



The Mycenaean Atlas Project has been updated with database MAP_Rev_0.040__10_06_17_Test

This version features an improved set of points for Epirus.

The following sites have been added:


C5012,
Methana: Ayios Konstantinos 1,
37.589527,
23.398818
C5013,
MS14,
37.596981,
23.397269
C5014,
Ayios Ioryios: MS124,
37.637316,
23.397879
C5015,
Oga Plateau: MS67,
37.617108,
23.411783
C5016,
Nissaki: MS103,
37.576135,
23.390485
C5017,
Vromoneri: MS108,
37.597041,
23.389416
C5018,
Magoula: MS60,
37.632303,
23.340154
C5019,
Vromolimni: MS106,
37.59256,
23.393287
C5020,
Koropi Health Center: hab,
37.914173,
23.875781
C5021,
Koropi: Kotzia and Hera Streets: Burial,
37.91059,
23.872957
C5022,
Athens: Olympic Complex,
37.879415,
23.967678
C5023,
Marathon EH Cem: Tsepi,
38.128754,
23.96633
C5024,
Schinias: hab,
38.161312,
24.011267
C5025,
Kato Souli: Cemetery Complex,
38.163544,
24.0172
C5026,
Angelokastro: Hab,
38.557735,
21.266056
C5027,
Palaiopyrgos: Meropi,
40.02975,
20.484873
C5028,
Kato Meropi Cem,
40.020684,
20.515843
C5029,
Mazaraki: Cem,
39.805276,
20.607913
C5030,
Liatovouni: hab,
40.021862,
20.661524
C5031,
Liatovouni: Cem,
40.01991,
20.661038
C5032,
Skaphidaki,
38.960731,
20.823303
C5033,
Ioannina: Katamachi: Hoard,
39.480157,
20.645232
C5034,
Ioannina: Katamachi: Hab,
39.482219,
20.662227
C5035,
Preveza: Stefani: Hoard,
39.179822,
20.789405
C5036,
Ioannina: Krya: hab,
39.719765,
20.83561
C5037,
Kastritsa: Weapon,
39.622335,
20.908208
C5038,
Vitsa,
39.876613,
20.745324
C5039,
Kato Pedina,
39.890768,
20.671019
C5040,
Sevasto: Liminari Hill: Goutsoura (PS 12),
39.416208,
20.487653
C5041,
Terovo/Terobo,
39.411043,
20.87441
C5042,
Christou/Christos,
39.555247,
21.112993

Thursday, September 28, 2017

Update Database 0.038 for Helladic.info

The database for the helladic.info site has been updated.  This is version

 MAP_Rev_0.038__09_27_17_Test

Regions around Aigion and Patras in Achaia have been clarified.

The following points have been added:

 C5000 ,  Stylia: Pyrgouthi: Fort 
 C5001 ,  Tarsina: Bouzaka 
 C5002 ,  Krinai: Zakoura 
 C5003 ,  Kryoneri, Kato Bathiza 1 
 C5004 ,  Helike 
 C5005 ,  Kallithea: Cem 
 C5006 ,  Kallithea: Hab 
 C5007 ,  Mylon: Ayios Nikolaos 
 C5008 ,  Keryneia: EH hab 
 C5009 ,  Krini: Ayios Konstantinos 
 C5010 ,  Petroto: Skodreika 
 C5011 ,  Prosilio: Cem 

Saturday, February 25, 2017

Chronology in the Mycenaean Atlas Project

“Absolute chronology is simple in concept
but fiendish in practice;…”

Manning [2010], 18

Use Cases for Relative and Absolute Chronology 
in the Mycenaean Atlas Project.

In my previous post I discussed the ‘findt’ table which identifies the general type of a Mycenaean site.

In this post I want to discuss the ‘Period’ and ‘Time_span’ tables which give values for the time or era in which any particular site was created and/or occupied.

Periods in Bronze Age archaeology are usually conceived of as ‘Ceramic Horizons’ (in this post I’ll refer to these as ‘CH’) - those broad blocks of time in which certain types of ceramics were in customary use.  These periods are the ones most of us are familiar with: LHII, LHIIIA1, MH, etc.  The essential insight is that, while we may rarely know the specific year in which any ceramic type was in use, we can arrange the ceramic horizons themselves in a time sequence.  We can say, for example, that dishes typed as ‘LHII’ were used at a time earlier than those typed ‘LHIII’ no matter what specific years those names may correspond to.


Sites in the Mycenaean Atlas Project that are securely typed 'LHIIA'.


The result of a century of pottery study has led to a profusion of (sometimes conflicting) names as well as an unhelpful overlap between differently named ceramic horizons from other regions such as Cyprus or Crete.

In addition to these problems there has, in recent years, grown up a heated debate over when the transition between LHI and LHII occurred .  The resolution of this problem rests on exactly when the volcano on the island of Thera erupted.[1]  Since this problem has been allowed to go unresolved and since passions are high on both sides it has become the custom to maintain two dating schemes in which the start and length of LH II differs between the schemes by a century.  These two schemes are referred to as the ‘High’ and the ‘Low’ chronology.

As a result, with respect to Bronze Age and Iron Age chronology, we have the knowledge organization problem par excellence. 

The intended goal of my database implementation of both the relative and absolute chronologies is to support Use Cases such as the following:

1.  Provide a mechanism for storing CH information for specific Myceaean sites along with the literature source that the CH is derived from.
E.g., if Simpson [1981] says on page 133 that site ‘C102’ was used in the LH IIIA then that association needs to be stored.[2]

2.   Retrieve all the CH information for a specific site or sites.  This is the reverse of the previous.  Here the user wishes to retrieve what anyone has said about the CH for any specific site or sites.

3.  Select start (and/or stop) year for a specific ceramic horizon.  In other words the user must be able to retrieve start and stop years corresponding to a CH name such as ‘LHII’.  This, of course, is the absolute chronology criterion.[3]

4.  Select start (and or stop) year for a specific CH using either the low/high chronology.  This is the same as the previous except it further specifies that the user may retrieve either ‘High’ or ‘Low’ chronology time spans.

5.  Produce output for CH names using one of a variety of user-specified conventions, e.g. LH IIIA1, or L.H. III a1, or SH iii A1, etc.  This is because the literature, which uses a variety of styles as well as foreign languages, refers to the same CH in very different ways.

6.  Select a range of different CHs for a site and output them in chronological order.  To explain this requirement consider that ‘LH’ is alphabetically prior to ‘MH’ but posterior to it in time.

7.  Support overlapping CH names.  For example we must be able to get sensible answers to queries for ‘LHII’ as well as its subperiods, ‘LHIIA’ or ‘LHIIB’ even though these overlap.  

8.  Fundamentally different systems such as Cycladic and Minoan have to be handled sensibly with respect to each other and with Helladic.

How are these use cases to be implemented?  The first thing is to agree on an internal representation of the CH names.  I have used the convention in which all spaces and periods are removed, all letters are capitalized.  Numbers such as I, II, or III are retained as roman numerals in upper case.  All other numbers are simple cardinals.  All foreign language usages are converted to the English language equivalent For example:

L.H. IIIb1 à LHIIIB1;   remove periods and spaces and convert LC to UC.

SH II à LHII          ; German.  Foreign language CH names are translated.

Every CH name must map onto a distinct character sequence for that horizon.  These names are stored in the era field of the period table and the time_span table.

I stress that these are the internal names only.  No one will ordinarily see them except those who work on the DB.  Corresponding to these internal names we must also have an external or printable form or forms.  The DB supports that with the field ‘EraPrint’. 

Imagine the following query:

select EraPrint from Time_Span where Era = ‘LHIIIA2’;

At present the DB would return the value ‘LH IIIA2’.

Currently the DB does not support foreign languages but that is a simple add-on.  Additional fields can be implemented for values such as ‘EraPrint_G’ or ‘EraPrint_F’ for German or French.

The above query could then become:

select EraPrint_G from Time_Span where era = ‘LHIIIA2’;

Such a query would output: ‘SH IIIA2’.

Requirement 6, above, specifies the ability to output date ranges in CH name order.  Under this requirement the CH name ‘LH’ must appear after ‘MH’.  How is that to be arranged?  In order for this to work there must be at least one field in the time_span table on which sorts can be performed.  We want to facilitate queries of this kind:

select EraPrint from time_span where Era in (‘EH’, ‘LHIIIB’, ‘MHIII’, ‘MHII’, ‘MHI’);

This query might return the values like this:

‘EH’,
‘LH IIIB’
‘MH III’,
‘MH II’,
‘MH I’

This result is in the wrong chronological order.  In order to make chronological ordering possible the time_span table must contain a sequence field.  This is a simple integer field which provides a unique number whose magnitude corresponds correctly to the actual chronological period of each CH name.  For example the previous query can be rewritten like this:

select eraPrint from period where era in (‘EH’, ‘LHIIIB’, ‘MHI’, ‘MHII’, ‘MHIII’) order by Seq;

Using the seq field will always return values in the right chronological order like this:

‘EH’,
‘MH I’,
‘MH II’,
‘MH III’
‘LH IIIB’


Under requirement 4 the DB must support the return of start and stop period years for either the ‘High’ or ‘Low’ chronology.  The solution to this is to provide both date ranges in the time_span table and require the user to supply either the word ‘High’ or the word ‘Low’.  Queries such as the following, which return the start and stop years for each named CH must be possible:

select distinct EraPrint, yPost, yAnte from time_span where hilo = 'High' and Era in ('EH', 'LHIIIB', 'MHIII', 'LHI', 'LHII', 'MHII', 'MHI') order by seq;

EH, 3100, 2100
MH I, 2100, 1850
MH II, 1850, 1775
MH III, 1775, 1700
LH I, 1700, 1635
LH II, 1635, 1410
LH IIIB, 1320, 1190

select distinct EraPrint, yPost, yAnte from time_span where hilo = 'Low' and Era in ('EH', 'LHIIIB', 'MHIII', 'LHI', 'LHII', 'MHII', 'MHI') order by seq;

EH, 3100, 2100
MH I, 2050, 1900
MH II, 1900, 1775
MH III, 1775, 1650
LH I, 1650, 1550
LH II, 1550, 1410
LH IIIB, 1320, 1190

If you examine the LH I and LH II start dates for each of the previous two queries you will see the difference between ‘High’ and ‘Low’ chronologies.  As I look at these results I think that I may have begun LHII too soon in both of these modes.  This is a simple data change that does not affect the structure of the DB tables. 

The time_span table is basically a table of DB constants and is never modified by the user.

Now that I’ve discussed some of the preliminaries I will devote the next post to the exact structure of the ‘Period’ and ‘Time_Span’ tables.

~~~~~~~~~~~~~~


Anyone who would like to have a copy of the MAP database can send an e-mail to bobconsoli 'at' gmail.com or leave a comment on any of my posts.  To run the MAP database requires a SQL server running on your desktop computer.   MySQL is such a server and it is powerful, industry-standard, and free.  

I can and will make .kml or .kmz files, which can be opened directly in Google Earth, available to those who would like them.  

I can also create .csv files for people who would like to import Mycenaean Atlas Project data into Google Earth but would like it in tabular form.

Those who do not have a SQL server but would like the full database in .pdf form can have that for the asking.

If you like these posts then please follow me on Twitter (Squinchpix) or on Google+   (Robert Consoli)

Facebook?  Sorry.I.just.can't.



Footnotes

[1]  A nuanced study of the problem of high vs. low chronology is in Manning [2010], esp. pp. 18-24.

[2] Simpson [1981], p. 133, ‘F 139 Stoupa: Ancient Leuktra’.

[3] Manning [2010], 18.

Bibliography

Cline [2010]: Cline, Eric H., ed., The Oxford Handbook of the Bronze Age Aegean.  Oxford University Press, Oxford, United Kingdom. 2010.  ISBN: 978-0199873609.

Manning [2010]: Manning, Sturt.  ‘Chronology and Terminology’, in Cline [2010], pp. 11-28.

Simpson [1981]: Simpson, Richard Hope. Mycenaean Greece. Park Ridge, New Jersey: Noyes Press, 1981.

Blog Posts Concerning the Isthmian Wall

Since 2023 a number of posts concerning the Isthmian Wall and how we located its remaining segments, have appeared on this blog.  This post ...