Description loops

Every candidate description of the eight loops, against the text it revised

Authors

Affiliations

Fadel M. Megahed

Farmer School of Business, Miami University

Ying-Ju (Tessa) Chen

College of Arts and Sciences, University of Dayton

This page shows the candidate descriptions of the eight description loops of the analysis document (its section “Description loop” and figure F2). Each loop starts from the generic description, candidate 1. Each later candidate revises the current best, the last kept candidate before it. A candidate is kept when its design AUC is at least 0.02 above the current best. The last kept candidate is the final description.

Each text is shown against the text that it revised: added words are bold and underlined in the color of the model, and removed words are struck through. A text that keeps less than a quarter of the words of the text it revised is shown in full and marked written anew. Rows in grey are candidates that the loop did not keep. The descriptions are the text of the loop logs (results/fair/loop/), unchanged. R/description_diff.R makes the word diffs, and the paper shows the table of one loop. The analysis document lists the same candidates in full, with the reason that the agent gave (its section “Loop candidates”, table A2).

Overview

Model	Dataset	Candidates	Kept	Design AUC, generic	Design AUC, final	Final candidate
JEV	Extrusion	6	3	0.59	0.78	3
JEV	Textiles	2	2	0.92	0.99	2
JEV	Pipe staple	1	1	0.99	0.99	1
JEV	Microstructure	4	2	0.77	0.95	2
Clef-Flash	Extrusion	6	2	0.71	0.76	2
Clef-Flash	Textiles	5	3	0.85	0.93	4
Clef-Flash	Pipe staple	2	2	0.57	1.00	2
Clef-Flash	Microstructure	5	2	0.89	0.94	3

JEV: extrusion

Candidate	Revises	Design AUC	Kept	Nominal description	Defective description
1	generic	0.585	yes	No visible manufacturing defects; the part appears conforming.	At least one visible manufacturing defect or anomaly.
2	1	0.738	yes	A close-up of a 3D printing nozzle and freshly extruded plastic; the extruded material forms a smooth, even layer of steady width that lies flat on the print surface. written anew	A close-up of a 3D printing nozzle and extruded plastic where the amount of material is wrong: either a thin, stringy or broken strand with dark gaps showing through, or a bulging, blobby, overly wide mass of plastic. written anew
3	2	0.783	yes	A close-up of a 3D printing nozzle and freshly extruded plastic; the extruded material forms a smooth, even layer or strand of steady width that lies flat on the print surface. with straight, clean edges. The background around it may be dark or light.	A close-up of a 3D printing nozzle and extruded plastic where the amount of material is wrong: either a thin, stringy or broken strand with dark gaps showing through, strand with breaks or gaps within the plastic itself, or a bulging, blobby, overly wide mass of plastic.
4	3	0.778	no	A close-up of a 3D printing nozzle and freshly extruded plastic; the extruded material forms a smooth, even layer or strand of steady width with straight, clean edges, which may be wide and flat and may turn a corner in a smooth, rounded bend. The background around it may be dark or light.	A close-up of a 3D printing nozzle and extruded plastic where the amount of material is wrong: either a thin, stringy strand with breaks or gaps within the plastic itself, or a bulging, blobby, overly wide mass of plastic. lumpy, bulging blob of plastic with an uneven, swollen outline.
5	3	0.758	no	A close-up of a 3D printing nozzle and freshly extruded plastic; the extruded material forms a smooth, even layer or strand of steady width with straight, clean edges. The background around it may be dark or light.	A close-up of a 3D printing nozzle and extruded plastic where the amount of material is wrong: either a thin, stringy strand with breaks or gaps within the plastic itself, too little plastic, seen as a strand that is narrower than the nozzle, wavy or ragged at the edges, faint, or broken, or a bulging, blobby, overly wide mass of plastic.
6	3	0.763	no	A close-up of a 3D printing nozzle and freshly extruded plastic; the extruded material forms a smooth, even layer or strand of steady width with straight, clean edges, and it may turn a corner in a smooth, rounded bend. The background around it may be dark or light.	A close-up of a 3D printing nozzle and extruded plastic where the amount of material is wrong: either a thin, stringy strand with breaks or gaps within the plastic itself, or a bulging, blobby, overly wide mass of plastic.

JEV: textiles

Candidate	Revises	Design AUC	Kept	Nominal description	Defective description
1	generic	0.917	yes	No visible manufacturing defects; the part appears conforming.	At least one visible manufacturing defect or anomaly.
2	1	0.991	yes	Grey fabric with a soft, smooth texture of long diagonal streaks that blend gently into each other; no spots, marks or areas that differ from the rest. written anew	Grey fabric with a visible anomaly: either a small local spot or mark, or a texture that is grainier, more speckled and noisier across the whole image, with short choppy strokes instead of long smooth diagonal streaks. written anew

JEV: pipe staple

Candidate	Revises	Design AUC	Kept	Nominal description	Defective description
1	generic	0.994	yes	No visible manufacturing defects; the part appears conforming.	At least one visible manufacturing defect or anomaly.

JEV: microstructure

Candidate	Revises	Design AUC	Kept	Nominal description	Defective description
1	generic	0.770	yes	No visible manufacturing defects; the part appears conforming.	At least one visible manufacturing defect or anomaly.
2	1	0.945	yes	A grain map whose grain colors are random and spread evenly over the whole color spectrum; no hue or hue family is more common than the others, and similar colors do not cluster together. written anew	A grain map in which grain colors are not evenly spread: one or two hue families (for example reds, or reds and cyans) are clearly more common than the rest, or grains of similar color cluster in patches or bands. written anew
3	2	0.943	no	A grain map whose grain colors are random and spread evenly over the whole color spectrum; no hue or hue family is more common than the others, and similar colors do not cluster together. neighboring grains almost always have unrelated colors.	A grain map in which grain colors are not evenly spread: one or two hue families (for example reds, or reds and cyans) are clearly more common than the rest, or grains of similar color cluster in patches or bands. somewhere in the map a group of several neighboring grains shares similar shades of one hue, forming a patch or band of related colors.
4	2	0.936	no	A grain map whose grain colors are random and spread evenly over the whole color spectrum; no hue or hue family is more common than the others, reds, yellows, greens, cyans, blues and purples all appear about equally often, and similar colors do not cluster together.	A grain map in which grain colors are not evenly spread: one or two hue families (for example reds, or reds and cyans) are clearly more common than the rest, or so that some other part of the spectrum (for example blues and greens, or purples) is rare or missing, or grains of similar color cluster in patches or bands.

Clef-Flash: extrusion

Candidate	Revises	Design AUC	Kept	Nominal description	Defective description
1	generic	0.708	yes	No visible manufacturing defects; the part appears conforming.	At least one visible manufacturing defect or anomaly.
2	1	0.764	yes	Extruded material forms a smooth, continuous strand or layer of even width, with clean straight edges and no blobs, gaps or thin spots. written anew	Extruded material is uneven: either too much material, with blobs, bulges, swelling or smeared excess, or too little material, with thin, broken or stringy strands, gaps and voids. written anew
3	2	0.748	no	Extruded material forms a smooth, continuous strand or layer of even width, with clean straight edges and no blobs, gaps or thin spots. Blur, glare, low contrast and a cluttered or dark background are normal and are not defects.	Extruded material is uneven: either too much material, with blobs, bulges, swelling or smeared excess, or too little material, with thin, broken or stringy strands, gaps and voids.
4	2	0.737	no	Extruded material forms a smooth, continuous strand or layer of even width, about as wide as the nozzle tip it leaves, with clean straight edges and no blobs, gaps or thin spots.	Extruded material is uneven: either too much material, wider than the nozzle tip, with blobs, bulges, swelling or smeared excess, or too little material, narrower than the nozzle tip, with thin, broken or stringy strands, gaps and voids.
5	2	0.764	no	Extruded material forms a smooth, continuous strand or layer of even width, with clean straight edges straight parallel sides and no blobs, gaps or thin spots.	Extruded material is uneven: either too much material, with blobs, bulges, swelling or smeared excess, or too little material, with thin, broken or stringy strands, gaps and voids. The outline of the material is rounded, bulbous, curved or tapering instead of straight-sided.
6	2	0.736	no	Extruded material forms a smooth, continuous strand or layer The extruded strand carries the right amount of material: it is smooth, continuous and of even width. with clean straight edges and no blobs, gaps or thin spots.	Extruded material is uneven: either too much material, with blobs, bulges, swelling or smeared excess, The extruded strand carries the wrong amount of material: too much, so it bulges or blobs, or too little, material, with so it is thin, broken or stringy strands, gaps and voids. has gaps.

Clef-Flash: textiles

Candidate	Revises	Design AUC	Kept	Nominal description	Defective description
1	generic	0.855	yes	No visible manufacturing defects; the part appears conforming.	At least one visible manufacturing defect or anomaly.
2	1	0.878	yes	Gray fabric with a uniform texture of smooth, soft diagonal streaks running evenly across the whole image; no spots or marks. written anew	Gray fabric where the texture differs from smooth even diagonal streaks: the whole surface looks rougher, coarser, mottled or clumpy, or there is a small spot, speck or foreign mark. written anew
3	2	0.827	no	Gray fabric with a uniform texture of smooth, soft diagonal streaks running evenly across the whole image; no spots or marks.	Gray fabric where the texture differs from smooth even diagonal streaks: the whole surface looks rougher, coarser, mottled or clumpy, or somewhere in the image, even near an edge, there is a small spot, speck or foreign mark. tiny tangled tuft or knot of fibers with sharp dark and bright specks.
4	2	0.928	yes	Gray fabric with a uniform texture of smooth, soft diagonal streaks soft, slightly blurred texture of long diagonal streaks in light and dark gray, running evenly across the whole image; fine grain and gentle shading changes are part of this texture; no spots or marks.	Gray fabric where the texture differs from smooth even diagonal streaks: the whole surface looks rougher, coarser, mottled or clumpy, or there is a small spot, speck or foreign mark.
5	4	0.867	no	Gray fabric with a soft, slightly blurred texture of long diagonal streaks in light and dark gray, running evenly across the whole image; fine grain and gentle shading changes are part of this texture; no spots or marks.	Gray fabric where the texture differs from smooth even diagonal streaks: the whole surface looks rougher, coarser, mottled or clumpy, or there is a small spot, speck or foreign mark. a small isolated blot anywhere in the image, also near an edge or corner, breaks the direction of the streaks.

Clef-Flash: pipe staple

Candidate	Revises	Design AUC	Kept	Nominal description	Defective description
1	generic	0.569	yes	No visible manufacturing defects; the part appears conforming.	At least one visible manufacturing defect or anomaly.
2	1	0.997	yes	A small bright white rectangular clip (staple) sits on the thin dark pipe near the center of the image, where the pipe meets the metal bracket. written anew	The small white rectangular clip is missing from the thin dark pipe near the center; the pipe joint at the bracket shows only dark bare pipe with no white part on it. written anew

Clef-Flash: microstructure

Candidate	Revises	Design AUC	Kept	Nominal description	Defective description
1	generic	0.886	yes	No visible manufacturing defects; the part appears conforming.	At least one visible manufacturing defect or anomaly.
2	1	0.834	no	A grain map where grain colors are random and varied: neighboring grains have unrelated hues spread over the full color wheel, with no color family dominating any region. written anew	A grain map where grain colors are not random: many grains share one color family or two color families, or a region holds a cluster of neighboring grains of similar hue. written anew
3	1	0.936	yes	A grain map where grain colors are random and varied everywhere: neighboring grains have unrelated hues spread over the full color wheel, and no part of the map has a patch of touching grains in the same color family. written anew	A grain map where grain colors are not fully random: either many grains across the map share one or two color families, or one part of the map holds a patch of several touching grains in the same color family (for example a cluster of red and orange grains) while the rest looks varied. written anew
4	3	0.956	no	A grain map where grain colors are random and varied everywhere: neighboring grains have unrelated hues spread over the full color wheel, and no part of the map has a patch of touching grains in the same color family.	A grain map where grain colors are not fully random: either many grains across the map the palette is skewed so that reds and cyan/teal grains appear more often than greens, purples, yellows and olives, or many grains share one or two color families, or one part of the map holds a patch of several touching grains in the same color family (for example a cluster of red and orange grains) while the rest looks varied.
5	3	0.956	no	A grain map where grain colors are random and varied everywhere: all hue families (reds, oranges, yellows, olives, greens, cyans, blues, purples, pinks, greys) appear in roughly equal amounts, neighboring grains have unrelated hues, spread over the full color wheel, and no part of the map has a patch of touching grains in the same color family.	A grain map where grain colors are not fully random: either many grains across the map the palette is skewed so that reds and cyan/teal grains appear more often than greens, purples, yellows and olives, or many grains share one or two color families, or one part of the map holds a patch of several touching grains in the same color family (for example a cluster of red and orange grains) while the rest looks varied.