Abstract

Parametric modeling software is a powerful design tool for defining complex geometries, controlling precise dimensions, and maintaining design intent during iterative modifications. However, such software challenges novice users due to the complex user interfaces, steep learning curve, and the need for strong spatial understanding to manipulate 3D models. To overcome these barriers, we introduce pARametric, an augmented reality (AR) system that provides an effortless parametric modeling experience in situ. Our system features an immersive sketching platform for freehand sketching, a transformer-based parametric sketch construction algorithm, and an AR interface that offers intuitive hand-to-virtual geometry interaction for 3D modeling operations. In pARametric, a novice user without experience in 3D modeling can create parametric models for personal fabrication. Our system uses environmental context as design references to make decisions about structure, dimension, and shape. The system allows users to express their design intents by sketching freehand rather than mastering the sophisticated operations in current modeling software. We also incorporate widely used 3D modeling features such as extrusion, revolution, sweep, and mirror to create a wide variety of models. In a user study with eight participants, we discovered that novice designers see great potential in pARametric to enhance their capabilities and willingness to engage in parametric modeling. We further discuss how our system can be integrated into traditional parametric modeling workflows to benefit a wider range of designers in terms of visualization and collaboration on challenging design tasks.

References

1.
Stemasov
,
E.
,
Wagner
,
T.
,
Gugenheimer
,
J.
, and
Rukzio
,
E.
,
2022
, “
ShapeFindAR: Exploring In-Situ Spatial Search for Physical Artifact Retrieval Using Mixed Reality
,”
Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
,
New Orleans, LA
, pp.
1
12
.
2.
Thingiverse
,
2023
, https://www.thingiverse.com/, Accessed September 1, 2023.
3.
Myminifactory
,
2023
, https://www.myminifactory.com/, Accessed September 1, 2023.
4.
Grabcad
,
2023
, https://grabcad.com/, Accessed September 1, 2023.
5.
Shugrina
,
M.
,
Shamir
,
A.
, and
Matusik
,
W.
,
2015
, “
Fab Forms: Customizable Objects for Fabrication With Validity and Geometry Caching
,”
ACM Trans. Graph. (TOG)
,
34
(
4
), pp.
1
12
.
6.
Baudisch
,
P.
,
Silber
,
A.
,
Kommana
,
Y.
,
Gruner
,
M.
,
Wall
,
L.
,
Reuss
,
K.
,
Heilman
,
L.
,
Kovacs
,
R.
,
Rechlitz
,
D.
, and
Roumen
,
T.
,
2019
, “
Kyub: A 3D Editor for Modeling Sturdy Laser-Cut Objects
,”
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
,
Glasgow, Scotland, UK
, pp.
1
12
.
8.
Alcock
,
C.
,
Hudson
,
N.
, and
Chilana
,
P. K.
,
2016
, “
Barriers to Using, Customizing, and Printing 3D Designs on Thingiverse
,”
Proceedings of the 2016 ACM International Conference on Supporting Group Work
,
New York, NY
, pp.
195
199
.
9.
Arora
,
R.
,
Habib Kazi
,
R.
,
Grossman
,
T.
,
Fitzmaurice
,
G.
, and
Singh
,
K.
,
2018
, “
Symbiosissketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects In Situ
,”
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
,
Montréal, QC, Canada
, pp.
1
15
.
10.
Jackson
,
B.
, and
Keefe
,
D. F.
,
2016
, “
Lift-Off: Using Reference Imagery and Freehand Sketching to Create 3D Models in VR
,”
IEEE Trans. Vis. Comput. Graph.
,
22
(
4
), pp.
1442
1451
.
11.
Stemasov
,
E.
,
Wagner
,
T.
,
Gugenheimer
,
J.
, and
Rukzio
,
E.
,
2020
, “
Mix&Match: Towards Omitting Modelling Through In-Situ Remixing of Model Repository Artifacts in Mixed Reality
,”
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
,
Honolulu, HI
, pp.
1
12
.
12.
Surale
,
H. B.
,
Gupta
,
A.
,
Hancock
,
M.
, and
Vogel
,
D.
,
2019
, “
TabletinVR: Exploring the Design Space for Using a Multi-Touch Tablet in Virtual Reality
,”
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
,
Glasgow, Scotland, UK
, pp.
1
13
.
13.
Millette
,
A.
, and
McGuffin
,
M. J.
,
2016
, “
DualCAD: Integrating Augmented Reality With a Desktop GUI and Smartphone Interaction
,”
IEEE International Symposium on Mixed and Augmented Reality Workshops
,
Merida, Yucatan, Mexico
, pp.
21
26
.
14.
Drey
,
T.
,
Gugenheimer
,
J.
,
Karlbauer
,
J.
,
Milo
,
M.
, and
Rukzio
,
E.
,
2020
, “
VRSketchin: Exploring the Design Space of Pen and Tablet Interaction for 3D Sketching in Virtual Reality
,”
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
,
Honolulu, HI
, pp.
1
14
.
15.
Jiang
,
Y.
,
Zhang
,
C.
,
Fu
,
H.
,
Cannavò
,
A.
,
Lamberti
,
F.
,
Lau
,
H. Y.
, and
Wang
,
W.
,
2021
, “
HandPainter-3D Sketching in VR With Hand-Based Physical Proxy
,”
Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
,
Yokohama, Japan
, pp.
1
13
.
16.
Yu
,
X.
,
DiVerdi
,
S.
,
Sharma
,
A.
, and
Gingold
,
Y.
,
2021
, “
ScaffoldSketch: Accurate Industrial Design Drawing in VR
,”
The 34th Annual ACM Symposium on User Interface Software and Technology
,
Virtual Event
, pp.
372
384
.
17.
Kim
,
Y.
, and
Bae
,
S.-H.
,
2016
, “
SketchingWithHands: 3D Sketching Handheld Products With First-Person Hand Posture
,”
Proceedings of the 29th Annual Symposium on User Interface Software and Technology
,
Tokyo, Japan
, pp.
797
808
.
18.
Weichel
,
C.
,
Lau
,
M.
,
Kim
,
D.
,
Villar
,
N.
, and
Gellersen
,
H. W.
,
2014
, “
MixFab: a Mixed-Reality Environment for Personal Fabrication
,”
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
,
Toronto, ON, Canada
, pp.
3855
3864
.
19.
autodesk
,
2023
, https://www.autodesk.com/, Accessed September 1, 2023.
20.
Creo
,
2023
, https://www.ptc.com/en/products/creo, Accessed September 1, 2023.
21.
Solidworks
,
2023
, https://www.solidworks.com/, Accessed September 1, 2023.
22.
Gravitysketch
,
2023
, https://www.gravitysketch.com/, Accessed September 1, 2023.
23.
Hololens
,
2023
, https://www.microsoft.com/en-us/hololens/buy, d Accessed September 1, 2023.
24.
Cadquery
,
2023
, https://cadquery.readthedocs.io/en/latest/, Accessed September 1, 2023.
25.
Hudson
,
N.
,
Alcock
,
C.
, and
Chilana
,
P. K.
,
2016
, “
Understanding Newcomers to 3D Printing: Motivations, Workflows, and Barriers of Casual Makers
,”
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
,
San Jose, CA
, pp.
384
396
.
26.
Mahapatra
,
C.
,
Jensen
,
J. K.
,
McQuaid
,
M.
, and
Ashbrook
,
D.
,
2019
, “
Barriers to End-User Designers of Augmented Fabrication
,”
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
,
Glasgow, Scotland, UK
, pp.
1
15
.
27.
Buehler
,
E.
,
Kane
,
S. K.
, and
Hurst
,
A.
,
2014
, “
ABC and 3D: Opportunities and Obstacles to 3D Printing in Special Education Environments
,”
Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility
,
Rochester, NY
, pp.
107
114
.
28.
Buehler
,
E.
,
Branham
,
S.
,
Ali
,
A.
,
Chang
,
J. J.
,
Hofmann
,
M. K.
,
Hurst
,
A.
, and
Kane
,
S. K.
,
2015
, “
Sharing Is Caring: Assistive Technology Designs on Thingiverse
,”
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
,
Crossings, Seoul, Korea
, pp.
525
534
.
29.
Chen
,
X.
,
Kim
,
J.
,
Mankoff
,
J.
,
Grossman
,
T.
,
Coros
,
S.
, and
Hudson
,
S. E.
,
2016
, “
Reprise: A Design Tool for Specifying, Generating, and Customizing 3D Printable Adaptations on Everyday Objects
,”
Proceedings of the 29th Annual Symposium on User Interface Software and Technology
,
New York, NY
, pp.
29
39
.
30.
Hofmann
,
M.
,
Hann
,
G.
,
Hudson
,
S. E.
, and
Mankoff
,
J.
,
2018
, “
Greater Than the Sum of Its PARTs: Expressing and Reusing Design Intent in 3D Models
,”
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
,
Montréal, QC, Canada
, pp.
1
12
.
31.
Flath
,
C. M.
,
Friesike
,
S.
,
Wirth
,
M.
, and
Thiesse
,
F.
,
2017
, “
Copy, Transform, Combine: Exploring the Remix as a Form of Innovation
,”
J. Inf. Technol.
,
32
(
4
), pp.
306
325
.
32.
Kyriakou
,
H.
,
Nickerson
,
J. V.
, and
Sabnis
,
G.
,
2017
, “
Knowledge Reuse for Customization
,”
MIS Quart.
,
41
(
1
), pp.
315
332
.
33.
Saul
,
G.
,
Lau
,
M.
,
Mitani
,
J.
, and
Igarashi
,
T.
,
2010
, “
SketchChair: An All-in-One Chair Design System for End Users
,”
Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction
,
Funchal, Portugal
, pp.
73
80
.
34.
McCrae
,
J.
,
Umetani
,
N.
, and
Singh
,
K.
,
2014
, “
FlatFitFab: Interactive Modeling With Planar Sections
,”
Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology
,
Honolulu, HI
, pp.
13
22
.
35.
Lau
,
M.
,
Saul
,
G.
,
Mitani
,
J.
, and
Igarashi
,
T.
,
2010
, “
Modeling-in-Context: User Design of Complementary Objects With a Single Photo
,”
Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium
,
Annecy, France
, pp.
17
24
.
36.
Banerjee
,
S.
,
Carithers
,
C.
,
Chavan
,
A.
,
Ramanujan
,
D.
, and
Ramani
,
K.
,
2018
, “
Toying With Design: Experiencing Design for Rapid Prototyping Using Mini-Fabrication Exercises
,” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol.
51784
,
American Society of Mechanical Engineers
, p.
V003T04A007
.
37.
Booth
,
J. W.
,
Alperovich
,
J.
,
Chawla
,
P.
,
Ma
,
J.
,
Reid
,
T. N.
, and
Ramani
,
K.
,
2017
, “
The Design for Additive Manufacturing Worksheet
,”
ASME J. Mech. Des.
,
139
(
10
), p.
100904
.
38.
Li
,
Y.
,
Luo
,
X.
,
Zheng
,
Y.
,
Xu
,
P.
, and
Fu
,
H.
,
2017
, “
SweepCanvas: Sketch-Based 3D Prototyping on an RGB-D Image
,”
Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
,
Québec City, QC, Canada
, pp.
387
399
.
39.
Liu
,
V.
,
Vermeulen
,
J.
,
Fitzmaurice
,
G.
, and
Matejka
,
J.
,
2023
, “
3DALL-E: Integrating Text-to-Image AI in 3D Design Workflows
,”
Proceedings of the 2023 ACM Designing Interactive Systems Conference
,
Pittsburgh, PA
, pp.
1955
1977
.
40.
Huo
,
K
,
Vinayak
, and
Ramani
,
K
,
2017
, “
Window-Shaping: 3D Design Ideation by Creating on, Borrowing from, and Looking at the Physical World
,”
Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction
,
Yokohama, Japan
.
41.
Mohanty
,
R. R.
,
Castillo
,
R. M.
,
Ragan
,
E. D.
, and
Krishnamurthy
,
V. R.
,
2020
, “
Investigating Force-Feedback in Mid-Air Sketching of Multi-planar Three-Dimensional Curve-Soups
,”
ASME J. Comput. Inf. Sci. Eng.
,
20
(
1
), p.
011010
.
42.
Li
,
C.
,
Pan
,
H.
,
Bousseau
,
A.
, and
Mitra
,
N. J.
,
2020
, “
Sketch2CAD: Sequential Cad Modeling by Sketching in Context
,”
ACM Trans. Graph. (TOG)
,
39
(
6
), pp.
1
14
.
43.
Yeh
,
T.
, and
Kim
,
J.
,
2018
, “
CraftML: 3D Modeling is Web Programming
,”
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
,
Montréal, QC, Canada
, pp.
1
12
.
44.
Ballagas
,
R.
,
Wei
,
J.
,
Vankipuram
,
M.
,
Li
,
Z.
,
Spies
,
K.
, and
Horii
,
H.
,
2019
, “
Exploring Pervasive Making Using Generative Modeling and Speech Input
,”
IEEE Pervasive Comput.
,
18
(
4
), pp.
20
28
.
45.
Lee
,
B.
,
Cho
,
M.
,
Min
,
J.
, and
Saakes
,
D.
,
2016
, “
Posing and Acting as Input for Personalizing Furniture
,”
Proceedings of the 9th Nordic Conference on Human-Computer Interaction
,
Gothenburg, Sweden
, pp.
1
10
.
46.
Nealen
,
A.
,
Igarashi
,
T.
,
Sorkine
,
O.
, and
Alexa
,
M.
,
2007
, “
Fibermesh: Designing Freeform Surfaces With 3D Curves
,”
ACM Transactions on Graphics (TOG)
,
26
(
3
), p.
41–es
.
47.
Igarashi
,
T.
,
Matsuoka
,
S.
, and
Tanaka
,
H.
,
1999
, “
Teddy: A Sketching Interface for 3D Freeform Design
,”
Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques
,
New York
, pp.
409
416
.
48.
Kazi
,
R. H.
,
Grossman
,
T.
,
Cheong
,
H.
,
Hashemi
,
A.
, and
Fitzmaurice
,
G. W.
,
2017
, “
DreamSketch: Early Stage 3D Design Explorations With Sketching and Generative Design
,”
Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
,
Québec City QC Canad
, pp.
401
414
.
49.
Xin
,
M.
,
Sharlin
,
E.
, and
Sousa
,
M. C.
,
2008
, “
Napkin Sketch: Handheld Mixed Reality 3D Sketching
,”
Proceedings of the 2008 ACM symposium on Virtual reality software and technology
,
Bordeaux, France
, pp.
223
226
.
50.
Butterworth
,
J.
,
Davidson
,
A.
,
Hench
,
S.
, and
Olano
,
M. T.
,
1992
, “
3DM: A Three Dimensional Modeler Using a Head-Mounted Display
,”
Proceedings of the 1992 Symposium on Interactive 3D Graphics
,
Cambridge, MA
, pp.
135
138
.
51.
Deering
,
M. F.
,
1995
, “
HoloSketch: A Virtual Reality Sketching/animation Tool
,”
ACM Trans. Comput.-Human Interact. (TOCHI)
,
2
(
3
), pp.
220
238
.
52.
Xu
,
X.
,
Zhou
,
Y.
,
Shao
,
B.
,
Feng
,
G.
, and
Yu
,
C.
,
2023
, “
GestureSurface: VR Sketching Through Assembling Scaffold Surface With Non-Dominant Hand
,”
IEEE Trans. Vis. Comput. Graph.
,
29
(
5
), pp.
2499
2507
.
53.
Yu
,
E.
,
Arora
,
R.
,
Stanko
,
T.
,
Bærentzen
,
J. A.
,
Singh
,
K.
, and
Bousseau
,
A.
,
2021
, “
Cassie: Curve and Surface Sketching in Immersive Environments
,”
Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
,
Yokohama, Japan
, pp.
1
14
.
54.
Mohanty
,
R. R.
,
Bohari
,
U. H.
,
Vinayak
, and
Ragan
,
E.
,
2018
, “
Kinesthetically Augmented Mid-Air Sketching of Multi-planar 3D Curve-Soups
,” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol.
51739
,
American Society of Mechanical Engineers
, p.
V01BT02A031
.
55.
Arora
,
R.
,
Kazi
,
R. H.
,
Anderson
,
F.
,
Grossman
,
T.
,
Singh
,
K.
, and
Fitzmaurice
,
G. W.
,
2017
, “
Experimental Evaluation of Sketching on Surfaces in VR
,”
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
,
New York, NY
, pp.
5643
5654
.
56.
Romat
,
H.
,
Fender
,
A.
,
Meier
,
M.
, and
Holz
,
C.
,
2021
, “
Flashpen: A High-Fidelity and High-Precision Multi-surface Pen for Virtual Reality
,”
2021 IEEE Virtual Reality and 3D User Interfaces (VR)
,
Lisboa, Portugal
, pp.
306
315
.
57.
Wacker
,
P.
,
Wagner
,
A.
,
Voelker
,
S.
, and
Borchers
,
J.
,
2020
, “
Physical Guides: An Analysis of 3D Sketching Performance on Physical Objects in Augmented Reality
,”
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
,
Honolulu, HI
, pp.
1
14
.
58.
Machuca
,
M. D. B.
,
Stuerzlinger
,
W.
, and
Asente
,
P.
,
2019
, “
Smart3dguides: Making Unconstrained Immersive 3D Drawing More Accurate
,”
Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology
,
Parramatta, NSW, Australia
, pp.
1
13
.
59.
Ye
,
H.
,
Kwan
,
K. C.
, and
Fu
,
H.
,
2021
, “
3D Curve Creation on and Around Physical Objects With Mobile AR
,”
IEEE Trans. Vis. Comput. Graph.
,
28
(
8
), pp.
2809
2821
.
60.
Barrera Machuca
,
M. D.
,
Stuerzlinger
,
W.
, and
Asente
,
P.
,
2019
, “
The Effect of Spatial Ability on Immersive 3D Drawing
,”
Proceedings of the 2019 Conference on Creativity and Cognition
,
New York
, pp.
173
186
.
61.
Seff
,
A.
,
Zhou
,
W.
,
Richardson
,
N.
, and
Adams
,
R. P.
,
2021
, “Vitruvion: A Generative Model of Parametric CAD Sketches”. arXiv preprint arXiv:2109.14124.
62.
Ashbrook
,
D.
,
Guo
,
S. S.
, and
Lambie
,
A.
,
2016
, “
Towards Augmented Fabrication: Combining Fabricated and Existing Objects
,”
Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems
,
San Jose, CA
, pp.
1510
1518
.
63.
Hincapié-Ramos
,
J. D.
,
Guo
,
X.
,
Moghadasian
,
P.
, and
Irani
,
P.
,
2014
, “
Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions
,”
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
,
Toronto, ON, Canada
, pp.
1063
1072
.
64.
Jang
,
S.
,
Stuerzlinger
,
W.
,
Ambike
,
S.
, and
Ramani
,
K.
,
2017
, “
Modeling Cumulative Arm Fatigue in Mid-Air Interaction Based on Perceived Exertion and Kinetics of Arm Motion
,”
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
,
Denver, CO
, pp.
3328
3339
.
You do not currently have access to this content.