Project CLi MB Computational Linguistics for Metadata Building

Project CLi. MB Computational Linguistics for Metadata Building Columbia University Funded by the Andrew W. Mellon Foundation 2002 -2004 Using Computational Linguistic Techniques to Harvest Image Descriptors

Photograph courtesy of the Council of Industrial Design's Design Archive. 2

3

CLi. MB: Interdisciplinary Research at Columbia University Funded by the Andrew W. Mellon Foundation 2002 -2004 • • • Libraries Computer Science Department Center for Research on Information Access (CRIA) 4

CLi. MB Project Members Judith Klavans, PI Stephen Davis Angela Giral Patricia Renfro Bob Wolven Roberta Blitz Rebecca Passonneau Veronika Horvath David Elson 5

Problems in Image Access Traditional approach: labor intensive expensive 6

Project CLi. MB Help image catalogers provide subject access? Harvest image descriptors from existing literature?

Can we harvest image descriptors? 8

CLi. MB Technical Contribution CLi. MB will identify and extract • proper nouns • terms and phrases from text related to an image: By September 14, 1908, the basis of the Greenes' final design had been worked out. It featured a radically informal, V-shaped plan (that maintained the original angled porch) and interior volumes of various heights, all under a constantly changing roofline that echoed the rise and fall of the mountains behind it. The chimneys and foundation would be constructed of the sandstone boulders that comprised the local geology, and the exterior of the house would be sheathed in stained split-redwood shakes. — Edward R. Bosley. Greene & Greene. London: Phaidon, 2000. p. 127. 9

CLi. MB Overall Goals The essence of CLi. MB: • Use scholars themselves as “catalogers” by employing scholarly publications • Enhance existing descriptive metadata The CLi. MB project: • Research: Development of richer retrieval through increased numbers of descriptors • Practice: Development of CLi. MB Tool. Kit 10

Squeezing Metadata out of Scholarly Texts • Image collection • Associated text • Target object identification (TOI) • CLi. MB Tool. Kit 11

Greene & Greene Architectural Records and Papers Collection Drawings and Archives Avery Architectural and Fine Arts Library Columbia University Libraries

NYDA. 1960. 001. 00023 All Saints Episcopal Church (Pasadena, Calif. ). Alterations 1902 -1903

Greene & Greene Catalog Record Author: Title: Published: Greene & Greene. [Mrs. Dudley P. Allen house, 1188 Hillcrest Avenue (Pasadena, Calif. ). Alterations. ] Residence of Mrs. Dudley P. Allen, 1188 Hillcrest Ave. , Pasadena, Cal. [graphic] : Alteration / Greene & Greene, Architects. [1917] Physical Details: Location: 4 sheets : various media ; 87. 8 x 57. 3 cm. (34 5/8 x 22 5/8 in. ) Columbia University, Avery Architectural Drawings Other Authors: Greene, Charles Sumner, 1868 -1957. Greene, Henry Mather, 1870 -1954. Houses Alterations Architecture--Designs and plans--United States. Mrs. Dudley P. Allen house, 1188 Hillcrest Avenue (Pasadena, Calif. ) Subjects: Component Item: [1] Item no. NYDA. 1960. 001. 03224. [AVERYimage]. Electric lighting -floor plan, part plan of basement : Sheet no. Component Item: [2] Item no. NYDA. 1960. 001. 00073. [AVERYimage]. [Electric lighting] floor plan, part plan of basement. 14

Greene & Greene Bibliography (associated texts) • Bosley, Edward R. Greene & Greene. London : Phaidon, 2000. • Current, William R. Greene & Greene: architects in the residential style. Fort Worth [Tex. ] : Amon Carter Museum of Western Art, [1974] • Makinson, Randell L. Greene & Greene: architecture as fine art. Salt Lake City : Peregrine Smith, c 1977. • Makinson, Randell L. Greene & Greene: the passion and the legacy. Salt Lake City : Gibbs and Smith, c 1998. • Smith, Bruce. Greene & Greene masterworks. San Francisco : Chronicle Books, c 1998. • Strand, Janann. A Greene & Greene guide [Pasadena, Calif. : G. Dahlstrom, 1974]

Squeezing Metadata out of Scholarly Texts • Image collection • Associated text • Target object identification (TOI) • CLi. MB Tool. Kit 17

Target Object Identification (TOI) • “Authority” list • Varies from collection to collection – Greene & Greene – Project Names – North Carolina Museum – Creator/Title 18

North Carolina Museum of Art Museum Catalog (Associated Text) Images (Catalog Records) North Carolina Museum of Art: Handbook of the Collections. Ed. Rebecca Martin Nagy. Raleigh, NC: North Carolina Museum of Art, Hudson Hills Press, 1998. 20

Georgia O'Keeffe (American, 1887 -1986) Cebolla Church, 1945 Oil on canvas, 20 1/16 x 36 1/4 in. (51. 1 x 92. 0 cm. ) Purchased with funds from the North Carolina Art Society (Robert F. Phifer Bequest), in honor of Joseph C. Sloane, 72. 18. 1 North Carolina Museum of Art <http: //ncartmuseum. org/collections/highlights/20 thcentury/20 th/1910 -1950/038_lrg. shtml>

MARC format 100 245 260 300 500 535 650 650 O’Keeffe, Georgia, ≠d 1887 -1986. Cebolla church ≠ h [slide] / ≠ c Georgia O’Keeffe. ≠c 2003 1 slide : ≠ b col. Object date: 1945. Oil on canvas. 20 x 36 in. North Carolina Museum of Art ≠ b Raleigh, N. C. Painting, American ≠ y 20 th century. Women artist ≠ z United States Church buildings in art. 22

Cebolla Church, 1945 Oil on canvas, 20 1/16 x 36 1/4 in. (51. 1 x 92. 0 cm. ) Purchased with funds from the North Carolina Art Society (Robert F. Phifer Bequest), in honor of Joseph C. Sloane, 72. 18. 1 Driving through the New Mexican highlands near her home, Georgia O'Keeffe would often pass through the village of Cebolla with its rude adobe Church of Santo Niño. The artist was moved by the poignancy of the little building: its sagging, sun-bleached walls and rusted tin roof seemed so typical of the difficult life of the people. When O'Keeffe came to paint the church she addressed it directly, emphasizing its isolation and stark simplicity. Literally formed out of the earth, the building affirms the permanence and the hard, defiant patience of the people. For O’Keeffe, it symbolized human endurance and aspiration. "I have always thought it one of my very good pictures", she wrote, "though its message is not as pleasant as many others". And the question remains: What is that in the window?

MARC format with CLi. MB subject terms 100 245 260 300 500 535 650 650 O’Keeffe, Georgia, ≠d 1887 -1986. Cebolla church ≠ h [slide] / ≠ c Georgia O’Keeffe. ≠c 2003 1 slide : ≠ b col. Object date: 1945. Oil on canvas. 20 x 36 in. North Carolina Museum of Art ≠ b Raleigh, N. C. Painting, American ≠ y 20 th century. Women artist ≠ z United States Church buildings in art. CLi. MB CLi. MB New Mexican highlands village of Cebolla adobe Church of Santo Niño sagging, sun-bleached walls rusted tin roof isolation human endurance window 24

Squeezing Metadata out of Scholarly Texts • Image collection • Associated text • Target object identification (TOI) • CLi. MB Tool. Kit 25

The CLi. MB Tool. Kit • Software prototype • For large image collections • Semi-automated metadata – Subject access terms – Human intervention at all steps • Iterative development cycle 26

The CLi. MB Tool. Kit A Graphical User Interface (GUI) • Web Browser • Help Menus • Projects 28

CLi. MB TOOLKIT: Process Flow 5. Review 4. Select Subject Access Terms 3. Analyze Text 2. Load TOI List 1. Load Text 29

CLi. MB Doc. Viewer http: //www 1. cs. columbia. edu/~delson/cni/

Thank you! Any further questions? www. columbia. edu/cu/cria/climb 31