0% found this document useful (0 votes)
11 views

Automatic 3d

The paper presents a novel method for automatically inferring 3D poses from 2D hand-drawn sketches, aimed at streamlining the animation production process. Utilizing a Particle Swarm Optimization variant called PARAC-LOAPSO, the method allows for versatile application across various character types without requiring a pre-existing database. The approach is evaluated through tests on different characters, demonstrating its robustness and potential for integration into existing animation workflows.
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
11 views

Automatic 3d

The paper presents a novel method for automatically inferring 3D poses from 2D hand-drawn sketches, aimed at streamlining the animation production process. Utilizing a Particle Swarm Optimization variant called PARAC-LOAPSO, the method allows for versatile application across various character types without requiring a pre-existing database. The approach is evaluated through tests on different characters, demonstrating its robustness and potential for integration into existing animation workflows.
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 6

Pacific Graphics (2014) Short Papers

J. Keyser, Y. J. Kim, and P. Wonka (Editors)

Automatic 3D Posing from 2D Hand-Drawn Sketches

Alexandros Gouvatsos1,2 , Zhidong Xiao1 , Neil Marsden2 , Jian J. Zhang1

1 Centre for Digital Entertainment, National Centre for Computer Animation, Bournemouth University, UK
2 Hibbert Ralph Animation, UK

Figure 1: From initial storyboard to pre-visualisation. The lamp in these three shots is automatically posed using the storyboard
drawing. On the top row, drawings are overlaid on top of the 3D scene with the assets unposed. On the bottom row, the lamp
has been posed automatically using our method.

Abstract
Inferring the 3D pose of a character from a drawing is a non-trivial and under-constrained problem. Solving it
may help automate various parts of an animation production pipeline such as pre-visualisation. In this paper, a
novel way of inferring the 3D pose from a monocular 2D sketch is proposed. The proposed method does not make
any external assumptions about the model, allowing it to be used on different types of characters. The 3D pose
inference is formulated as an optimisation problem and a parallel variation of the Particle Swarm Optimisation
algorithm called PARAC-LOAPSO is utilised for searching the minimum. Testing in isolation as well as part of a
larger scene, the presented method is evaluated by posing a lamp and a horse character. The results show that this
method is robust and is able to be extended to various types of models.
Categories and Subject Descriptors (according to ACM CCS): I.2.8 [Artificial Intelligence]: Problem Solving, Con-
trol Methods, and Search—Heuristic methods I.2.10 [Artificial Intelligence]: Vision and Scene Understanding—
Shape I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism—Animation I.4.9 [Image Processing
and Computer Vision]: Applications—

1. Introduction grounds, be it for posing [MQW06], animating [DAC∗ 03],


modelling [YW10], stylising motion [LGXS03] or simulat-
The field of animation has advanced rapidly, offering a
ing secondary movement [JSMH12] and crowds [MQW07].
plethora of ways to bring characters to life from sketching
By providing an intuitive link between the initial sketching
and joint manipulation to puppet posing and motion capture.
process and the end result, the cognitive load and the neces-
Since animation has its roots in hand drawings, being sary training for the artist may be significantly reduced.
able to show one’s ideas on paper is a skill most anima-
tors possess. As such, many have argued sketching is an in- Initial sketching is part of most animation pipelines al-
tuitive interface for artists of traditional and modern back- ready, usually in the form of storyboarding during pre-

c The Eurographics Association 2014.

DOI: 10.2312/pgs.20141264
126 A. Gouvatsos / Automatic 3D Posing from 2D Hand-Drawn Sketches

production. These drawings are then used by animators or or simply classifying [EHA12]. In animation, Jain et al.
pose artists to set up the initial pose layout before going into [JSH09] follows a database approach in order to infer the
the animation stage. Rather than introducing a new work- missing depth and pose humanoid characters. However, it
flow or step, the aim of the proposed method is to automate is able to handle only orthogonal camera projections, while
one of the existing steps. Specifically, the focus is on making the method proposed in this paper can handle both orthogo-
the initial posing stage of a production less labour intensive. nal and perspective projection. Building a database of poses
may be expensive, especially since motion capture cannot
Posing 3D models from 2D sketches is a non-trivial open
be easily used for non-humanoids that are so common in 3D
problem, closely related to the computer vision problem of
animation productions. As such, an approach that does not
inferring a 3D pose from a 2D photograph but with sev-
require a database was preferred.
eral differences. Photographs are usually accurate in terms
of scale and include colour information. Sketches may have Explicit shape model approach: This approach is very
squashing and stretching, usually lack colour and contain effective when there are multiple camera views because the
noise in the form of auxiliary strokes e.g. for shading. problem is no longer under-constrained (no occlusions). It
This paper focuses on using sketches to pose 3D charac- consists of comparing the 3D render pose to the 2D image in
ters automatically, for layout or pre-visualisation. order to estimate how close it is to a correct pose. One of its
limitations in computer vision is that it requires a 3D model
that is a good match to the 2D image. In 3D productions this
2. Related work limitation does not apply, since a 3D model exists anyway.
The mainstream method of posing 3D characters is by Favreau et al. successfully pose animals using Radial Ba-
manipulating controls of a skeletal structure, usually joints sis Functions of 3D pose examples [FRDC06]. Ivekovic et
[BW76]. Even with the invention of Inverse Kinematics al. [ITP08] infer 3D poses of humans in video sequences
[ZB94], this remains a time consuming process which re- using multi-view images. Ivekovic et al. still make human-
quires the user to be trained in specific suites of software. specific assumptions limiting its use to a small subset of
A drawing represents an internal model the artist has characters while both Favreau et al. and Ivekovic et al., use
about a scene and it contains no depth information. As video data and exploit temporal relations between frames.
such, the problem of inferring the depth from a drawing is
Posing interfaces: Interfaces to replace the mainstream
under-constrained, creating problems such as the forward-
skeleton manipulation process have been the focus of pre-
backward ambiguity problem (Figure 2).
vious research e.g. tangible devices [JPG∗ 14]. Examples
of sketch-based interfaces make use of differential blend-
ing [OBP∗ 13] or the line of action to pose 3D characters
[GCR13]. These sketch-based interfaces may offer improve-
ments, but are still operated by artists. The proposed method
is aiming to reduce the process to an automatic method a
user with no artistic background is able to perform.
This paper proposes a method for posing 3D mod-
Figure 2: An example of the forward-backward ambiguity els from 2D drawings, aiming at pose layout and pre-
issue in inferred 3D pose of a lamp when not using the inter- visualisation. It makes no assumptions about the 3D model
nal lines for additional information. in order to deal with many types of characters. Unlike Jain
et al. [JSH09], it does not rely on a database. Instead, a par-
Automatic 3D posing: In general, inferring a 3D pose ticle swarm optimisation (PSO) variant called Parallel Con-
from a drawing can be broken down into two sub-problems. vergence Local Optima Avoidance PSO (PARAC-LOAPSO)
Firstly, match the 3D model projection to the drawing. Sec- is used. This allows for posing of both cooperative (e.g. hu-
ondly, infer the missing depth. For 3D productions, the cam- mans) and non-cooperative (e.g. animals) characters. It does
era represents the position from which the characters in the not require the model to have a skeleton; any type of con-
drawing are viewed, according to the artist’s internal model. troller is suitable. Unlike Ivekovic et al. [ITP08] the input
data are monocular, stand-alone drawings with no tempo-
A comprehensive overview of progress in this computer
ral relations between them. Minimal user input is required,
vision problem [Gav99] highlights two main types of ap-
in the form of pinpointing the joints on top of the drawing.
proach, the explicit shape model approach and the database
To avoid forward-backward ambiguity, the proposed method
approach. In this case the focus is on data from drawings
uses a combination of various descriptors [FAK12]. There
rather than photographs or video frames.
are currently no other methods that perform automatic pos-
Database approach: Previous computer vision research ing for the layout phase of animation, that work irrespective
has used database approaches not only for tracking and pos- of the character model and that can be applied without the
ing [JSH09] but also for positioning [XCF∗ 13] in a scene need for a pre-existing database.

c The Eurographics Association 2014.


A. Gouvatsos / Automatic 3D Posing from 2D Hand-Drawn Sketches 127

3. Methodology vector X = ( j1 , ..., jn ), where n is the number of joints to


manipulate on the model. Each element j represents a joint
3.1. Overview
and is a three dimensional vector j = (x, y, z) where x, y and
To propose a general posing method which can automate the z are its Euler angle rotations in local space. Therefore, the
initial layout pass or pre-visualisation of a production, the search space contains all the possible poses for that model.
solution takes into account several requirements:
While issues of uncertain convergence, speed and getting
• Make no assumptions about the type of character, in order stuck at local minima have been explored [BK07], it is im-
to be versatile (e.g. humans, horses, lamps, octopuses). portant to re-examine them for this particular problem.
• Provide results which are good enough for the initial pos-
Improved search: To deal with slower convergence, a
ing and not the final animation.
constriction factor K (equation 1) [BK07] is preferred over
• Ensure necessary user input is quick and requires little
the inertia weight used by Ivekovic et al. [ITP08] or Sale-
learning from the user side.
hizadeh et al. [SYM09]. To speed up convergence and over-
• Do not restrict the traditional pipeline structure.
all runtime, the algorithm is implemented to run in parallel
• Be feasible for both small and big budget productions.
on the GPU. To deal with getting stuck at local minima, the
Since the proposed method is focusing on posing and not method proposed by Salehizadeh et al. is used to add vari-
generating a 3D model from a 2D sketch, it is assumed that ation in the population [SYM09]. Additionally, the optimi-
there is already a 3D model that corresponds to the character sation process is faster and more accurate by navigating a
in the drawing. Therefore, the explicit shape model approach smaller search space. That is achieved by using joints’ rota-
is utilised for solving the problem. tion limits from the given 3D model as constraints. Instead of
using biological data about human joint limits, only the joint
The 2D data is an artistic drawing e.g. a storyboard panel.
limit data from the 3D model are acquired. Any hierarchical
The 2D sketch itself does not need to be of high quality, but
assumptions would decrease the method’s versatility.
it does need to be accurate in terms of the shape and scale of
the object that will be posed. 2
K= √ (1)
To create a search space containing the wanted 3D pose, |2 − a − a2 − 4a|
an interface is used which allows users to overlay drawings a = φ1 + φ2 (2)
on top of a 3D space (Figure 1), moving the camera and The cognitive (influence by own findings) and social (influ-
placing unposed 3D models. This reduces the search space ence by others’ findings) weights are defined as φ1 and φ2 .
to consist of only local poses of a character, not translation
in 3D space (Section 3.2). To compare the 2D to the 3D data Initialisation: The overall performance of the algorithm
in the search space, the system extracts information from the is affected by its initialisation. Since no temporal data is
sketch. That is when the only user input required - the pin- assumed, as would be in the case of a video, a previous
pointing of the joints - takes place (Section 3.3). To navigate pose cannot be used as an initial point. Therefore, each el-
the search space and find the wanted pose, the system iter- ement jn of position Xi of each particle i is initialised from
atively poses and renders the 3D model of the character to a uniform random distribution: jn ∼ U(Xmin , Xmax ). The up-
match the drawing (Section 3.2). per and lower boundaries Xmin , Xmax ∈ [−360, 360] differ for
each element of Xi , since the joint rotation limits are used to
The process is not distruptive or encumbering on set them for each particle element.
pipelines, as it is not different to a traditional pipeline with a
3D layout pass. Additionally, drawings exist early on in pre- Fitness evaluation: After the initialisation step a fitness
production in the form of storyboards. The pinpointing of function f allows for the evaluation of each particle. Based
the joints can be done in a few seconds during the clean-up on this, the personal best position Bti of each particle i and
phase and does not require technical training. the global best position Btg from all particles are stored.
f = w1 D j + w2 Ds + w3 De (3)
3.2. PARAC-LOAPSO
where D j is a distance metric for the joint positions, Ds one
The problem of inferring the 3D pose from 2D data is for the shape silhouette and De for the edges (both internal
treated as a minimisation problem, by navigating a formu- and external), while w1 , w2 and w3 are the respective weights
lated search space using a variation of PSO called PARAC- for each component (e.g. 13 for equal weighting of all parts).
LOAPSO. It performs global search and a reason for choos-
Update: At the beginning of epoch t, the population of N
ing it is that it is parallel by nature, which makes it
particles is split into two subgroups of size γN and (1 − γ)N,
straight-forward to implement on a GPU [MIC10]. As meta-
where γ = r, r ∼ U(0, 1) if t < Tc tmax , or 1 otherwise. Tc is
heuristic, it makes no assumptions about the problem.
denoted as the threshold of convergence, which controls how
The problem is formulated by defining each particle as many epochs are dedicated to exploration and how many to
a possible pose or solution. Specifically, each solution is a exploitation. For example, for Tc = 34 only the last quarter

c The Eurographics Association 2014.


128 A. Gouvatsos / Automatic 3D Posing from 2D Hand-Drawn Sketches

Figure 3: Joints overlaid by a user on Figure 4: Edge map of a drawing of a Figure 5: Silhouette of a drawing of a
top of a drawing of a human. human, extracted using the Canny al- human.
gorithm.

of the epochs will be dedicated to exploitation. tmax is the Joints: The user overlays the positions of the joints on top
maximum number of epochs for a run. of the drawing (Figure 3). The position of the overlaid joints
on the drawing is compared to that of the 3D positions of the
Xit+1 = Xit +Vit+1 (4)
joints, transformed into screen space coordinates.
For every particle i, its position Xi is updated (equation 4). If
Edge map: To use internal lines in the drawing, the Canny
the particle belongs to the first population subgroup, its ve-
algorithm [Can86] is used to extract a binary map of the ex-
locity component Vit+1 is updated using equation 5. Other-
ternal and internal edges (Figure 4). Then the binary map of
wise, to attempt and avoid local minima by adding variation,
the drawing is compared with that of the rendered image.
it is updated using equation 6.
Silhouette: Finally, for the overall shape, the silhouette of
Vit+1 = K[Vit + c1 (Bti − Xit+1 ) + c2 (Btg − Xit+1 )] (5)
the drawing is used as a binary map (Figure 5). The silhou-
ette distance between the rendered image and the drawing is
Vit+1 = K{Vit − Lt [r1 (Bti − Xit+1 ) + r2 (Btg − Xit+1 )]} (6) calculated using a previously successful method [FAK12].
2t
Lt = 2 − (7)
tmax
4. Results
r1 , r2 ∼ U(0, 1) (8) The system was tested on two problems of different dimen-
c1 = φ1 r1 (9) sionality and difficulty: a lamp (Figure 6) and a horse (Figure
c2 = φ2 r2 (10) 7). The reason for choosing them was to evaluate whether
the proposed method is suitable irrespective of the problem.
Algorithm: The above components are combined in the Both models would be difficult to be posed via methods such
following steps to form the overall algorithm. as motion capture, especially the horse. Most motion cap-
ture solutions focus on humanoids and are not affordable
1. Initialise the swarm population, with global best Btg . for smaller studios. Apart from posing models in isolation,
2. For each particle i, with personal best Bti (in parallel): the proposed method is evaluated by posing a lamp within a
a. Update particle position (equation 4). scene using an existing storyboard drawing (Figure 1).
b. Update descriptors of 3D pose (Section 3.3). For these tests, the algorithm was ran for tmax = 1000
c. Evaluate fitness of particle (equation 3). epochs. The values φ1 and φ2 as defined in Section 3, were
d. If current fitness < Bti , set Bti to current fitness. set to a value of 2.05, which is the default value in the canon-
e. If current fitness < Btg , set Btg to current fitness. ical PSO [BK07] and ensures convergence of the swarm. The
minimum and maximum velocity of each particle were set
to -360.0 and 360.0 respectively, since this is the space of
3.3. Comparing drawings to renders
possible rotations. This means that in one epoch, a joint can
Three ways to compare the drawing with the 3D render were rotate at most by one complete rotation either clockwise or
chosen given their previous reported advantages and disad- counter-clockwise. The minimum and maximum position of
vantages. Joints are used by Jain et al. in order to find close each particle was set dynamically based on the angle rotation
poses from a database. In order to make use of the internal limits of each joint of the model, reducing the search space
edges, edge maps are simple, fast and as effective [TR07] of possible poses. The exploration phase (Section 3.2), was
as more expensive methods like Shape Context Histograms set to Tc = 34 , so the first tmax Tc = 750 epochs were dedicated
[AT06]. Finally, silhouettes have been used to find poses to exploration and the last quarter of epochs was focused on
generatively [ITP08] or to train models [AT04]. exploitation.

c The Eurographics Association 2014.


A. Gouvatsos / Automatic 3D Posing from 2D Hand-Drawn Sketches 129

Figure 6: Side by side comparison of the drawings (top) and the estimated 3D pose (bottom) for the lamp model.

1000 epochs took approximately 81 seconds on average However, it is this flexibility which leads to the main dis-
on a system with 8GB of RAM, an Intel HD Graphics 3000 advantage of this method. Since the approach is generative, it
GPU and an Intel Core i5-2520M 2.50GHz CPU. requires a rendering step in every iteration, which may mean
it takes a longer time to return a result. It is important to
note that the time to return a result is computational only,
meaning that this method is still able to contribute to reduc-
ing costs. Furthermore, implementing the method on a GPU
reduces the effects of this disadvantage significantly.
Since the PARAC-LOAPSO algorithm is stochastic, result
accuracy may vary between runs. However, a system with a
powerful graphics card can normalise the results through the
use of a large population of particles, which helps both in
searching as well as in having a more varied initialisation.

6. Conclusion
This paper proposes a method to automatically pose 3D
Figure 7: Side by side comparison of the drawings (top) and
models using information from monocular drawings. This
the estimated 3D pose (bottom) for the horse model.
approach is generative and deals with inferring a 3D pose as
an optimisation problem. The results show that it is general
enough to deal with many types of characters, and a lamp
5. Discussion and a horse model are successfully posed in different scenar-
It is important to note that this method does not aim to pro- ios. Moreover, it does not require changes in the pipeline to
duce final animated output. It aims at automating the ini- accommodate for it. The focus of the proposed method is to
tial pose layout phase or pre-visualisation, which is currently pose models for the pose layout phase or pre-visualisation,
performed manually by skilled operators. not final animated output. It may serve as a direct link be-
tween storyboarding and pose layout phases of a pipeline.
The choice of the method of comparing the drawing to
the render may have a notable effect on the end result. For It is worth examining more general or accurate descrip-
example, by not using the internal lines of a drawing, the tors and methods of comparing drawings to renders, such
forward-backward ambiguity problem can become an issue as a context-based approach on joints [JSH09]. Completely
as seen in Figure 2. removing the need for user input may be possible by using
medial axis methods [ABCJ08] to extract the curve skele-
The method proposed in this paper easily fits into tradi-
ton automatically from the drawing and then fit the character
tional animation pipelines. Unlike Jain et al. [JSH09], it does
skeleton to the curve skeleton.
not require pre-existing data and can use perspective and or-
thographic camera models. The pinpointing of the joints user A hybrid between the current optimisation approach and
input can take place as part of the clean up phase. The sys- a data-driven approach such as Jain et al. [JSH09] is another
tem is flexible and applicable to a broad range of models, area where future work may expand to, to get results faster
from objects like lamps, to quadrupeds like horses. while remaining more general than a pure database method.

c The Eurographics Association 2014.


130 A. Gouvatsos / Automatic 3D Posing from 2D Hand-Drawn Sketches

References [JPG∗ 14] JACOBSON A., PANOZZO D., G LAUSER O.,


P RADALIER C., H ILLEGES O., S ORKINE -H ORNING O.:
[ABCJ08] A BEYSINGHE S., BAKER M., C HIU W., J U T.: Tangible and modular input device for character articula-
Segmentation-free skeletonization of grayscale volumes for tion. ACM Transactions on Graphics (proceedings of ACM
shape understanding. In Shape Modeling and Applications, SIGGRAPH) 33, 4 (2014). 2
2008. SMI 2008. IEEE International Conference on (June 2008),
pp. 63–71. doi:10.1109/SMI.2008.4547951. 5 [JSH09] JAIN E., S HEIKH Y., H ODGINS J. K.: Leveraging
the talent of hand animators to create three-dimensional anima-
[AT04] AGARWAL A., T RIGGS B.: Learning to track 3d human tion. In Symposium on Computer Animation (2009), pp. 93–102.
motion from silhouettes. In In International Conference on Ma- doi:10.1145/1599470.1599483. 2, 5
chine Learning (2004), pp. 9–16. 4
[JSMH12] JAIN E., S HEIKH Y., M AHLER M., H ODGINS J.:
[AT06] AGARWAL A., T RIGGS B.: Recovering 3d human pose Three-dimensional proxies for hand-drawn characters. ACM
from monocular images. Pattern Analysis and Machine Intelli- Trans. Graph. 31, 1 (Feb. 2012), 8:1–8:16. 1
gence, IEEE Transactions on 28, 1 (Jan 2006), 44–58. doi:
10.1109/TPAMI.2006.21. 4 [LGXS03] L I Y., G LEICHER M., X U Y.-Q., S HUM H.-Y.: Styl-
izing motion with drawings. In Proceedings of the 2003 ACM
[BK07] B RATTON D., K ENNEDY J.: Defining a standard for SIGGRAPH/Eurographics Symposium on Computer Animation
particle swarm optimization. In Swarm Intelligence Sympo- (Aire-la-Ville, Switzerland, Switzerland, 2003), SCA ’03, Euro-
sium, 2007. SIS 2007. IEEE (April 2007), pp. 120–127. doi: graphics Association, pp. 309–319. URL: http://dl.acm.
10.1109/SIS.2007.368035. 3, 4 org/citation.cfm?id=846276.846320. 1
[BW76] B URTNYK N., W EIN M.: Interactive skeleton tech- [MIC10] M USSI L., I VEKOVIC S., C AGNONI S.: Marker-
niques for enhancing motion dynamics in key frame animation. less articulated human body tracking from multi-view video
Commun. ACM 19, 10 (Oct. 1976), 564–569. URL: http: with gpu-pso. In Proceedings of the 9th International Con-
//doi.acm.org/10.1145/360349.360357, doi:10. ference on Evolvable Systems: From Biology to Hardware
1145/360349.360357. 2 (Berlin, Heidelberg, 2010), ICES’10, Springer-Verlag, pp. 97–
[Can86] C ANNY J.: A computational approach to edge detection. 108. URL: http://dl.acm.org/citation.cfm?id=
Pattern Analysis and Machine Intelligence, IEEE Transactions 1885332.1885344. 3
on PAMI-8, 6 (Nov 1986), 679–698. doi:10.1109/TPAMI. [MQW06] M AO C., Q IN S. F., W RIGHT D. K.: Sketching-out
1986.4767851. 4 virtual humans: From 2d storyboarding to immediate 3d char-
[DAC∗ 03] DAVIS J., AGRAWALA M., C HUANG E., P OPOVI Ć acter animation. In Proceedings of ACM SIGCHI International
Z., S ALESIN D.: A sketching interface for articulated fig- Conference On Advances In Computer Entertainment Technol-
ure animation. In Proceedings of the 2003 ACM SIG- ogy (June 2006), ACM. 1
GRAPH/Eurographics Symposium on Computer Animation [MQW07] M AO C., Q IN S. F., W RIGHT D.: Sketch-based vir-
(Aire-la-Ville, Switzerland, Switzerland, 2003), SCA ’03, Euro- tual human modelling and animation. In Proceedings of the 8th
graphics Association, pp. 320–328. URL: http://dl.acm. International Symposium on Smart Graphics (Berlin, Heidelberg,
org/citation.cfm?id=846276.846322. 1 2007), SG ’07, Springer-Verlag, pp. 220–223. URL: http:
[EHA12] E ITZ M., H AYS J., A LEXA M.: How do humans sketch //dx.doi.org/10.1007/978-3-540-73214-3_24,
objects? ACM Trans. Graph. (Proc. SIGGRAPH) 31, 4 (2012), doi:10.1007/978-3-540-73214-3_24. 1
44:1–44:10. 2 [OBP∗ 13] Ö ZTIRELI A. C., BARAN I., P OPA T., DALSTEIN
[FAK12] F LEISCHMANN P., AUSTVOLL I., K WOLEK B.: B., S UMNER R. W., G ROSS M.: Differential blending for ex-
Particle swarm optimization with soft search space par- pressive sketch-based posing. In Proceedings of the 2013 ACM
titioning for video-based markerless pose tracking. In SIGGRAPH/Eurographics Symposium on Computer Animation
Advanced Concepts for Intelligent Vision Systems, Blanc- (New York, NY, USA, 2013), SCA ’13, ACM. 2
Talon J., Philips W., Popescu D., Scheunders P., Zemcik [SYM09] S ALEHIZADEH S. M. A., YADMELLAT P., M ENHAJ
P., (Eds.), vol. 7517 of Lecture Notes in Computer Science. M.-B.: Local optima avoidable particle swarm optimization.
Springer Berlin Heidelberg, 2012, pp. 479–490. URL: http: In Swarm Intelligence Symposium, 2009. SIS ’09. IEEE (March
//dx.doi.org/10.1007/978-3-642-33140-4_42, 2009), pp. 16–21. doi:10.1109/SIS.2009.4937839. 3
doi:10.1007/978-3-642-33140-4_42. 2, 4
[TR07] T RESADERN P., R EID I.: An evaluation of shape de-
[FRDC06] FAVREAU L., R EVERET L., D EPRAZ C., C ANI M.- scriptors for image retrieval in human pose estimation. In Proc.
P.: Animal gaits from video: Comparative studies. Graph. Mod- 18th British Machine Vision Conf., Warwick (Sept. 2007), vol. 2,
els 68, 2 (Mar. 2006), 212–234. URL: http://dx.doi. pp. 800–809. 4
org/10.1016/j.gmod.2005.04.002, doi:10.1016/
j.gmod.2005.04.002. 2 [XCF∗ 13] X U K., C HEN K., F U H., S UN W.-L., H U S.-M.:
Sketch2scene: Sketch-based co-retrieval and co-placement of 3d
[Gav99] G AVRILA D.: The visual analysis of human movement: models. ACM Transactions on Graphics 32, 4 (2013), 123:1–
A survey. Computer Vision and Image Understanding 73 (1999), 123:12. 2
82–98. doi:10.1006/cviu.1998.0716. 2
[YW10] YANG R., WÃ IJNSCHE B. C.: Lifesketch - a framework
[GCR13] G UAY M., C ANI M.-P., RONFARD R.: The line of ac- for sketch-based modelling and animation of 3d objects. In in
tion: An intuitive interface for expressive character posing. ACM âĂŸProceedings of the Australasian User Interface Conference
Trans. Graph. 32, 6 (Nov. 2013), 205:1–205:8. URL: http:// (AUIC 2010 (2010), p. 2010. 1
doi.acm.org/10.1145/2508363.2508397, doi:10.
1145/2508363.2508397. 2 [ZB94] Z HAO J., BADLER N.: Inverse kinematics positioning
using nonlinear programming for highly articulated figures. ACM
[ITP08] I VEKOVIC S., T RUCCO E., P ETILLOT Y. R.: Human Transactions on Graphics 13 (1994), 313–336. 2
body pose estimation with particle swarm optimisation. Evo-
lutionary Computation 16 (2008), 509–528. doi:10.1162/
evco.2008.16.4.509. 2, 3, 4

c The Eurographics Association 2014.

You might also like