-表示 -内涵 -神话 -范例 -句法

-诠释学家 -动作语码 -消音代码（隐含含义） -符号代码 -文化代码

-Social Semiotc社会符号学 - Three Mentafunction心理功能

-多模态的 -Discourse话语

Orchestrating:编排 Contributory:贡献 Embodied：提现

Definition: A science which studies the role of signs as part of social life.

Definition: A science which studies the role of signs as part of social life.

Investigate the nature of signs and the laws governing them.

Structuralism

Modern semiotic theory is also sometimes allied with a Marxist approach which stresses the role of ideology

Semiotics began to become a major approach to cultural studies in the late 1960s

Human experience is inherently multisensory, and every representation of experience is subject to the constraints and affordances of the medium involved.

More frequently and fluently a medium is used, the more 'transparent' or 'invisible' to its users it tends to become.

The choise of medium leads to influences that user may not be conscius

Umberto Eco:" Semiotics is concerned with everythin that can be taken as a sign"

The automated interpretation of images is a social and political project, rather than a purely technical one.

What work do images do in AI systems?

The method for introducing images into computer systems & How taxonomies order the foundational concepts that will become intelligible to a computer system.

How do humans tell computers which words will relate to a given image?

That computer vision is meant to serve in our society—the judgments, choices, and consequences of providing computers with these capacities.

Building AI systems requires vast amount of data

Training sets are the foundation on machine-learning systems

The image used in computer-vision systems composed of shaky assumptions

Image do not decribe themselves

Training sets (collection of images) has been labeled in various ways and categories

Idea: Map out the entire world of objects

The underlying structure of ImageNet is based on the semantic structure of WordNet, a database of word classifications

Nested Structure of Cognitive Synonyms认知同义词的嵌套结构

Divide an infinitely complex universe into separate phenomena

ImageNet Roulette: An Experiment in Classification

Divide an infinitely complex universe into separate phenomena

ImageNet Roulette: An Experiment in Classification

relationship between picture and concept recall physiogonomy人相学，the pseudoscientific伪科学的 assumption that something about a person's character can be gleaned by observing their features.

Objects perserve mathematically their forms

Created composite images of criminals, studied the feet of prostitutes, measured skulls, and compiled meticulous archives of labeled images and measurements

At the level of the image label is the assumption that someone’s gender identity can be ascertained

Eg. Classificatory schema: racial classification

Improve matters by producing “more diverse” AI training sets presents its own complications.通过生产“更多样化”的人工智能训练集来改善问题本身就是其复杂性。

Created as responese that can't recognize face of darker skin

“Diversity in Faces” (DiF) dataset

The dataset itself continued the practice of collecting hundreds of thousands of images

including facial symmetry and skull shapes to build a complete picture of the face

too the technical process of categorizing and classifying people is shown to be a political act

Using mathematical approch to quantify "diversity" and "evenness"均匀性

Expanding dataset can only imporve the accuracy but cannot effect the final classification.

Undergriding Assumption

The datasets of AI is built with unstable epistemological and metaphysical assumption认识论和玄学的假设

Datasets aren’t simply raw materials to feed algorithms算法, but are political interventions. （Bias）

Collecting Image, Categorzing, Lable is decided from sicial and political work.

Lots facial datasets that without consent was removed as they are obvious privacy and ethical violations.

Useless: Countless download and Production of AI

Consequence:Researchers cannot see the assumption, lables and classificatory that in new systems

Developing frameworks within which future researchers can access these data sets in ways that don’t perpetuate harm is a topic for further work

Physiognomists: Relationship between Image of person and the Character was inscribed.刻

Magritte: Images have unstable relationship to what they present.

Image has much broader politics of representation and self-representation.

Meaning of Image is basis architecture and contents of training sets for AI, which promote or discriminate, approve or reject, render visible or invisible, judge of enforce.

Future: 1. We need to examine them—because they are already used to examine us 2. Having wider public discussion about the consequences rather than keeping it in academic corridors.

Underexamined role: the power to shape the world in their own images.