Gio's Movie files: DOC

Movies Database Documentation

This the Master file on [brambles]/MyDocs/mov/doc.html; copyright 1996, 1997, 1998 Gio Wiederhold
Loaded into DB web files 25 September 1997. Updated December 1998.

This material was entered by Gio Wiederhold

The initial objective was as test data for students, to allow non-trivial exercises. There are fields suitable for complex joins, outerjoins, temporal joins, and recursion. It has also been used to investigate object-structured database technologies

This is a HTML version of the description of the movies database. It was based originally on the description from the Kamens and Wiederhold temporal paper. It also contains literature references in appendix A.

1. Introduction

The database was used originally in implementing the temporal queries in SQL is Wiederhold's movies database (see [21]) and for a number of other projects, both in Stanford classes and by research at the Un.of Maryland and others.. The database allows testing of theories about an implementation. Since it contains "real data", it allowing checking of results for semantic as well as syntactic correctness. Finally, the tables in the database consist of both journal and history relations (see 21, section 3), allowing us to test all of the different elements of an implementation.

The Overview section (2) below contains a summary of all the files and the URL pointers to them, or their parts or sections; see Section 3 for a full schema description.

A number of the fields are unsuitable for relational implementation, because they contain sets of values. These are best used in an object-capable implementation. The schema describes when such sets are to be expected. Encodings for several of the fields are listed in Section 4..

At the end of this document, in Appendix B., are some conversion rules for converting the HTML format to fields for relational or object databases.

2. Overview:

The central file (MAIN) is a list of movies, each with a unique identifier. These identifiers may change in successive versions. The actors (CAST) for those movies are listed with their roles in a distinct file. More information about individual actors (ACTORS) is in a third file. All directors in MAIN are listed in a fourth file (PEOPLE), with a number of important producers, writers, and cinematographers. A fifth file (REMAKES) links movies that were copied to a substantial extent from each other. The sixth file (STUDIOS) provides some information about studios show in MAIN. This documentation file provides supplementary information, and is an essential part of the database. Some images are also available, but not on-line now. There are many cross-linking names throughout the files, so many in fact that web browsers have choked when trying to make them live. Currently we simply try to be careful in naming films and people consistently. More detail follows below. Counts have been made using emacs `count-matches'.

2.1 -- MOVIES --

The main movies file is main.html. It contains 11435 `tr/td' table row entries (July 1999). It is complete for Hitchcock movies and TV shows, and has most films that can be related by topic, actors, director, history, and such to those films. It has also many films corresponding to a variety of interests of mine, former students etc., with an emphasis on historical value. MAIN is the "central" relation in the database; it is a journal relation that contains information about the movies themselves. The relation contains information about movies such as their titles, type, directors, and producers, as well as their year of release.
There is also a subset file of 82 Hitchcock full length Movies.

2.2 -- ACTORS --

The file actors.html has 6813 `tr/td' table row entries (July.1999) for many of the actors appearing in CASTS.
Also First part and Second part of actors.html, not maintained.
The key of the relation is "stagename", and there are intervals indicating the dates that the actor worked and the actor's lifetime. Other information in this relation is the actor's real name, background, and the type of roles he/she typically plays. References to images are kept here too.

2.3 -- DIRECTORS --

in file people.html The file lists all directors, as well as some other movie people, as producers and cinematographers (A total of 3290 `tr/td' table row entries, 3011 `@' directors as of July 1999).
The directors table is similar to the actors table in that it contains intervals for when the director worked and when he/she lived. The key of the relation is the field "name", which is the name under which the director directed. Director's key names do not contain any blanks. Typically the last name is used, when needed prefaced by an initial. A secondary unique key is defined for each director, up to three letters, based on the initial letters of the first, middle, and last names. This key will provide HTML HREF linkages among many of the files. As with the actors table, this table also includes the real name of the director among its fields ("lastname" and "firstname"). It also contains importat producers, cinematographers, musicians and composers, etc.

2.4 -- STUDIOS --

in file studios.html are important studios only (203 `tr/td' entries, sparse information).
The key of the studios relation is the name of the studio. The temporal information that is included is an interval indicating the years the studio was (or is) in operation, represented by the fields "startdate" and "enddate". This is a history relation.

2.5 -- CASTS --

in file casts.html This is a large (too large?) file of who acted as what in which movie. (46 009 tr/td entries, only partial for movies and roletypes, July 1999). Casts is an association relation, linking actors with movies. The key of the relation is the catenation of the two fields "film_id" and "actor"; no temporal information is included in this relation.
This file was too big for Netscape in 1996, so that also five working subsets were made available, however these are not kept up-to-date.
  1. casts of Hitchcock films;
  2. casts Part 1, directors coded A-B;
  3. casts Part 2, directors coded C-H;
  4. casts Part 3, directors coded H-O;
  5. casts Part 4, directors coded P-Z;
The four parts are still large files (6000-15000 entries; castsCH includes Hitchcock films

2.6 -- REMAKES --

in file remakes.html (1278 `tr/td' entries in July 1999).
This table (which is not extensively used in the temporal DB paper) gives information about movies that are remakes of other movies. It is very useful to test recursion in databases.

2.7 -- SYNONYMS --

This file has been superseded. All entries are now in the main file, as Alt(T:...) in the notes field. synonyms.html, contained 379 entries in Sep 1997) This list relates to the MOVIES in main.html.
Some movies are known by alternate titles, and can be accessed indirectly via this file..

2.8 -- QUOTES --

in file casts.html QUOTES. A few (26) memorable quotes from movies are listed in quotes.html.|1.

2.9 -- AWARDS --

in file actors.html. Types of awards and the awarding agencies are in awtypes.html.

2.10 -- AWARDS-RECEIVED --

is no longer a distinct file Awards received for special occasions are listed with individual entries in the files for ACTORS (actors.html).or MOVIE PEOPLE (people.html). Regular awards associated with a particular movies are given in MOVIES (main.html) and with a particular performance are listed in CASTS (casts.html).

2.11 -- REFERENCES --

Books that provided material for this database are listed within this documentation file as Appendix A.

2.12 -- GEOGRAPHY --

Codes for countries and origins are listed within this documentation file as section 4.3: doc.html GEO.

2.13 -- CATEGORIES --

Codes for movie categories are listed within this documentation file as Section 4.4: doc.html CATS.

2.14 -- COLOR-CODES --

Codes for color processes used for movies are listed within this documentation file as Section 4.5: doc.html COLS.

2.15 -- ROLE-TYPES --

Codes that specify role-types for actors are listed in the preamble for casts.html ROLES.

2.16 -- FIELD-IDENTIFIERS --

Codes that identify subfields in various files are listed within this documentation file as Section 4.2: doc.html FIELDS.

2.17 - AWARD TYPES --

Lists the award types used in MAIN, ACTORS, and PEOPLE, with the organizations who award them, and the span of years they were awarded.

2.19 -- IMAGES --

there is a small collection of .tiff files for actors and directors. They are kept individually in an images subdirectory.

2.20 -- ICONS --

There are about a dozan icons to be used to identify subfiles. Some of them come from the New Yorker Magazine Jan.1993. There are kept individually in an icons subdirectory.

3. Schema Definition for the Movies Database

Here we give a detailed description of the schema of the movies database, which is used for all examples in this paper and was used to implement the temporal SQL additions. General descriptions are given in Section 2, above.
This file is being updated to desctribe the HTML version. Where updates were made, the old material is in curly {brackets}.

3.1 The MOVIES Table

Col-Name = Description
. There is a distinct table for each director (Hitchcock has multiple tables, one for early silent, one for British, one for American, and one for TV movies).
The tables are broken up p by year of first known film by the directors. There are some break and header records for each year.
Each director table has two types of records:
  1. one header record for the director, with the director id, as shown in people, the first year known for movies by that director, prefixed by an @ symbol, matching the people entry, and the standard name for the director, also matching the people entry.
    The remainder shows the format for the data records that follow below.. The note field is often used to describe the set of detail records
    For movies where the director in not known there is a dummy entry, either by topic (Unknown) or by year (UnYear), as shown in the people file.
  2. any number of records, one per film, formatted as shown below.

film_id =

title = year = director = producers= studios = prc = cat = awards = lc = notes =

3.2. The ACTORS Table

There is one record for each actor listed, but not all actors listed in CAST are documented. There are also break and header records for each letter of the alphabet.
Col-Name = Description

stagenm =

dowstrt = dowend = birthnm = firstnm = gender = dob = dod = type = origin = photo = notes =

3.3 The PEOPLE Table

Directors are the major subset of the general people.html table. Other entries are significant producers, writers, art directors and some authors. Being a director is indicated in the Pcode field, and has some effect on other fields. There are also break and header records for each letter of the alphabet.
Col-Name = Description

id-name =

Pcode = Did = yearstart= yearend= lastnm = firstnm = dob = dod = backgrd = notes =

3.4 The STUDIOS Table

Col-Name = Description ----------- -------------

name =

company = city = country = fddate = enddate = founder = successor = notes =

3.5 The CASTS Table

The large CAST file is broken up into sections by initial letter(s) of the directors identifying code. In each section will be a number of directors, ordered by code. There is a distinct table for each director.
Col-Name = Description
    Each director table has two types of entries
  1. one header record giving the director's id, name, and format information.
  2. multiple records for each movie and listed actor. There are no headers for distinct movies.

film_id =

title = actor = roletype= role = awards = notes =

3.6 The REMAKES Table

Col-Name = Description

film_id =

title = year = part = wasfilm = wastitle= wasyear =

3.7 -- SYNONYMS table

This file has been superseded. All entries are now in the main file, as Alt(T:...) in the notes field. Col-Name = Description

film-id =

s-title = s-country = p-country = p-title =

3.8 -- QUOTES table

Col-Name = Description ----------- -----------

film-id =

title = speaker = role = listenr = quote =

3.9 -- AWARDS table

Col-Name = Description ----------- -----------

award =

agency = place =

3.10 -- AWARDS table

Col-Name = Description ----------- -----------

recepnt =

award = year = reason = notes =

3.11 -- REFERENCES table

Col-Name = Description ----------- -----------

no. =

author = title = pub-inf =

3.12 -- GEOGRAPHY table

Col-Name = Description ----------- -----------

code =

. See 4.1 for the encoding used. country-name = c-adjective =

3.13 -- CATEGORIES table

Col-Name = Description

ctcode = Four-letter code

Movie categories
codecategory|codecategory|codecategory |
Ctxxuncategorized|
Actnviolence|Advtadventure|AvGaAvant Garde|
Campnow - camp|Cartcartoon|CnR Cops and Robbers|
Comdcomedy|
DisaDisaster| Docudocumentary| Dramdrama|
Epicepic|Famlfamily |Histhistory |
Horrhorror| Muscmusical|Mystmystery|
Noirblack| Pornpornography|Romtromantic|
ScFiscience fiction| Surlsureal|Suspthriller |
Westwestern|

3.14 -- COLOR-CODES table

Col-Name = Description ----------- -----------

color-code =

full = They are listed in the preamble for movies.macros.

3.15 ROLE-TYPES table

Col-Name = Description ----------- -----------

role-codes =

3.16 FIELD-IDENTIFIERS table

Col-Name = Description ----------- -----------

codes =


4: CODE TABLES

A fair amount of the information is encoded for consistency of reference. Directors' names are always treated as codes, and many other movie people as well. Names with out spaces are codes, and can be found in the PEOPLE relation. Actors names are treated as codes as well, although here first names have been retained. Many actors can be found in the ACTORS relation.
All movies have been assigned a code by catenating a director's identifier, found in the PEOPLE relation with sequence digits.
Several code tables appear below, other used are

Remote code tables

Local code tables

4.1 -- FIELD-DESIGNATORS --

These codes are used in certain filed to further identify the contents.

Check this, much changed when moving to HTML.

codedefinition|
T:film title|
T2: redefinition of title in main.html SYNS.|
T3: title used for locale file in MAIN |
T4: title used for License plate list in MAIN|
T5: title |
T6: title used in casts.html SAYINGS.|
T6: title used in quotes.html.|
TS:not sure of actor spellingused in CASTS obsolete |
TZ:title from Movies-dir.html|
TZ:not sure if actor in this filmused in CASTS|
P: producer in PEOPLE|
PN: producer full name not yet classified|
PU: unknown producer not yet classified|
St: listed studionot yet consistent|
SN: studio name|
SU: studio name unknown|
SL: country or city of studio|
SD: distributor old codes: Dtr, Ds, Dis{\Dtr|
R: roleused in CASTS|
RZ: role uncertainused in CASTS|
RU: role unknownused in CASTS|
RN: only name in roleused in CASTS|
RS: spelling of actor's name unsureused in CASTS|
D:|
DN: director with full name, may not be in PEOPLE filewas \DiF|
DU:|

4.2 -- FIELD-IDENTIFIERS --

Ancillary information, and social and professional relationships is frequently given as sub-fields in notes. Below are the prefixes used for such variable information. Some refer to candidate entries in other files. Many occur in the MAIN file, in the final NOTES field, others in the PEOPLE and ACTORS files. There should be only one sub- field of any type in the notes field, but they may have contain multiple entries If the contents references entries in a file, it is listed, but such a reference is only assured if coded with a colon ( : ). Some of these designations are repeated with the files themselves.
CodeContentsOcurrs inReferences what|
Aliasother professional names PEOPLE, ACTORSnone |
Alsoother professionsMAIN, ACTORSPEOPLE |
Altalternative titleMAIN (SYNONYMS)none |
BBook AuthorMAIN, ACTORSPEOPLE |
BS was Brother or Sister of, use SiPEOPLE, ACTORSPEOPLE |
CCinematographerMAIN, PEOPLE, ACTORSPEOPLE |
CoDCoDirectorMAINPEOPLE |
CostCost to make film [M/K]MAINnone|
Chchild ofPEOPLE ACTORSPEOPLE, ACTORS |
ChorchoreographerMAIN, ACTORSPEOPLE |
DtrdistributorMAINSTUDIO |
Erpossible error, verifyallnone |
FdFounded: STUDIOS PEOPLE , ACTORS|
FdrFounder of: PEOPLE , ACTORS STUDIOS |
GnFPEOPLEused for Female producer or director |
IncIncome from film [M/K]MAINnone|
Infinfluenced PEOPLE, ACTORSPEOPLE , ACTORS|
Inbinfluenced by PEOPLE, ACTORSPEOPLE, ACTORS |
LwLived withPEOPLE, ACTORSPEOPLE, ACTORS |
McomposerMAIN, PEOPLE, ACTORSPEOPLE |
MtMarried toPEOPLE, ACTORSPEOPLE, ACTORS |
Ntnoteallnone |
PplaywrightMAIN, ACTORSPEOPLE |
Ptparent ofPEOPLE, ACTORSPEOPLE, ACTORS |
Phunusual physical characteristics,
as height, weight, ..
ACTORS none |
RARt director, now VMAIN, PEOPLE, ACTORSPEOPLE |
Seen [dd[MMM]]yyMAINnone|
StstudioMAIN, ACTORSPEOPLE |
Si PEOPLE, ACTORSPEOPLE, ACTORS |
Tytypical stylePEOPLE, ACTORSTable 4.4 |
VVisual art directorMAIN, ACTORS, PEOPLEPEOPLE |
VT have video tape (number)MAINnone|
WwriterMAIN, PEOPLE, ACTORSPEOPLE |
Wwworked withPEOPLE, ACTORSPEOPLE, ACTORS |

4.3 -- GEOGRAPHY --

Codes for countries and origins are listed below. It is still incomplete. .
Common countries for movie making are listed first, followed by other countries in alphabetical order
codecountryadjective|codecountryadjective|
AmUSAAmerican|
Brnot usedBritish| GBGreat Britainnot used|
FrFranceFrench|
GeGermanyGerman|
ItItalyItalian|
JaJapanJapanese|
Alphabetical by code|
ArArgentiniaArgentine|
AuAustraliaAustralian|
BeBelgiumBelgian|
BzBrazilBrazilian|
CaCanadaCanadian|
ChChina, PRCChinese|
CzCzechoslovakiaCzech|
DaDenmarkDanish|
GrGreeceGreek|
DuHollandDutch|
HuHungaryHungarian|
InIndiaIndian|
IrIrelandIrish|
MeMexicoMexican|
OsAustriaAustrian|
PePeruPeruvian|
RuUSSR, RussiaRussian|
SpSpainSpanish|
SASouth-AfricaSouth-African|
YuYugoslaviaYugoslav|
ZwSwitzerlandSwiss|

4.4 -- CATEGORIES --

Codes for movie categories are listed below. Mainly used in MAIN, also content of Type fields. Multiple entries are possible.
codecategory|
Susp thriller|
CnR cops and robbers|
Dram drama|
West western|
Myst mystery|
S.F. science fiction|
Advt adventure|
Horr horror|
Romt romantic|
Comd comedy |
Musc musical|
Docu documentary|
Porn pornography, including soft|
Noir black|
BioP biographical Picture|
TV TV show|
TVs TV series|
TVm TV miniseries|

4.5 -- COLOR-CODES --

Codes for color processes used for movies in MAIN are listed below.
codefull namedescription|
prcunknown|
colcolorcolor film, common after 1955|
bnwblack-and-whiteb-w film common before 1945|
sbwsilentsilent black-and-white film |
cldcoloredblack-and-white film recolored|
CartcartoonCartoons are normally colored|
TcolTechnicolorhigh quality color |
EcolEastmancolor color by Kodak N\t(unstable)|
WcolWarnercolor|
McolMetrocolor Color by MGM|
AcolAnscocolorcolor by Kodak? |
AgcolAgfacolor|
FcolFujicolor|
DeLuxeDeLuxelow cost color|
DuArtDuArtcolor|
MovielabMovieLabcolor|
CSCinemascopewidescreen, mostly color |
Trama Technirama widescreen color |
PanPanaVision|
TVfilm made for TVvarious processes|
VstVistavision|

Appendix A: References

Electronic material Books about Actors

Web pages

BOOKS I have for Movie Stories:

Appendix B: CONVERSION

This section refers to the original HTML files. The notes are still being developed.

To convert the source files from HTML format to another type of database:

(we use [] to denote HTML `french' brackets.)

  1. remove header notes
  2. remove miscellaneous HTML commands, as [HTML], [/HTML], [BODY], [/BODY], [HR], ...
  3. for relational files ignore all lines starting with [tr][th]. These are header lines suitable for schema definitions. They could also become the roots of large director objects for the main and cast files.
  4. remove tabs and carriage returns. All content lines end with [td]| .
  5. records are divided into fields, as documented in the file schemas above, by [td]. A space follows [td] entries, preceding the content of the next field. Missing fields are indicated by two `[td] [td]', or by `[td] dummy entry[td]', as indicated in the file descriptions above.
  6. Many fields can have multiple entries. Simple relational transforms may drop such fields, others may require normalized sub-relations.
    Multiple values in a field a separated by
    1. 1. `,' if the values are of the same type, as [td] Romt, Dram[td]
    2. 2. `;' or `:' if they are of different types, as W(Ben Hecht; AAN)
    If both `;' and `,' appear in a field, then the `;' typically distinguishes a major group relative to the `,' value separator, as [td] island, South Pacific; court, SF, CA[td].
  7. In the Note fields may be a variable number of different types of entries, each of the form
    TypeCode(field), as W(Eliot Stannard)
  8. When names of producers, writers, etc, in fields do not contain blanks, as [td] P:A.Hughes[td], then the name exists in the people.html file, and can be used as an interfile reference.