In weeks 7 & 8 workshops we learned the basic skills of motion graphics, their uses and how they can be applied to our projects.

What are Motion Graphics?

Motion graphics differ from video effects or augmented reality. Rather, they are made up of shape elements that can be manipulated into an animation by using ‘motion paths’ in a sequential order. Below is an example  video of how these graphics can have effects added onto them to allow them to move in various ways:

This is purely an experimental video of how Adobe After Effects can create and manipulate shapes from a blank composition. For this sequence I compiled a basic timeline of a range of elements that move in their own form and direction. The possibilities of motion graphics are almost limitless in this sense, in the way that many different kinds of animation can be produced by using different shapes, colours, effects etc.

The second video is another unrelated experiment-  one that I created to explore how motion graphics can be used to transform a singular shape into multiple different images. For this video I used a circle and the idea of day transforming into night, then night into outer space. I used the shape tool settings in After Effects to create the basic elements of my video before using motion tools to animate them into different positions in the frame.

In the workshop we used motion graphics to create a personal branding/logo video. The animation was a simple sequence of various shape elements that combine to create a ‘self portrait’, which could potentially be used for the final convergence task.

Benefits and uses

There are many beneficial uses for motion graphics, particularly in the realm of gaming, graphic design and online advertising. It can be used to demonstrate informative and entertaining videos in an artistic and stylistic manner, ones that grab the user’s attention much more easily compared to live action videos. Although it can be challenging to develop and practice these ideas, it can have a significant impact on the way that marketing, government and entertainment industries put forward their promotions, ideas and products. Motion graphics can also be useful in schools, particularly for young children as their learning is often developed through engaging in artistic and colourful practices. I could use this for my own project by creating the ‘logo’ of me or to add animated images that resemble my inspirations, my hobbies, etc.

Disadvantages

There are some disadvantages to using and even creating motion graphics. First of all it can be very time consuming, which puts pressure on those working for a business or in the creative industries to meet deadlines. Secondly, due to the fact that the majority of the graphics are manually done using software such as After Effects it can be tricky to make the exact type of image that the artist wants- for example detailed and intricate objects. It is best used when making shapes/silhouettes of basic elements such as a coffee cup or lamppost.

This week we looked at 3D motion tracking, its comparison to 2D motion tracking and how we were able to use this in difference ways within one video. For convenience I will shorten this to ‘3DMT’.

What is 3D motion tracking?

3D motion tracking has very similar properties to 2D motion tracking, except that it is more complex and can be used for a wider variety of visual effects. It works almost exactly like 2DMT works except that is able to perceive the Z axis as well as the X and Y. 3DMT can be used to replace and alter images that move within a shot, or to include additional visuals. In the example video below 3DMT is displayed in terms of a ‘sky replacement’- showing how motion tracking can be used to alter an environment.

This video was created by using a high shutter speed footage of a road on a normal, bright day. 3DMT was used to replace the sky with an image that changes the overall tone and feel to the video. In simple terms, motion trackers were applied to two key objects on opposite sides of the frame (using Adobe After Effects) so that the image of the evening sky could be applied onto them. This meant that the image would move in proportion to how the camera moved during the shot. Effects were also applied so that the video footage and sky replacement would match in terms of realistic settings (i.e. colour correction and lens flare for sunlight).

This video above uses the same original road footage, however a different element of 3D motion tracking has been applied. This type of motion tracking (called ‘track camera’) uses ‘targets’ in Adobe After Effects to calculate points within the shot that can be easily traceable. In this video the markers that were used were stones and pebbles on the ground, this was then used as an area in which to edit the hole onto. The hole was originally a still image with its background removed- this meant it could be manipulated onto moving footage easily. As 3DMT is able to utilise the X, Y and Z axis this meant that the hole would remain in its position when the camera changed angles, unlike with 2D. Due to the flatness of the image, duplicate layers had to be reproduced and edited so that there was some depth to the inside of the hole (the laws of parallax here dictating that more of the hole should be revealed as the camera moves closer to it). Colour correction and other texturing effects were also applied so that the image looked a little more realistic and blended in appropriately with its environment. If this video were to be improved the hole itself could be edited so that the texture looks more photo-realistic, as well as the lighting being correct in relation to the light source. Other elements could also be included such as fire, damage and burn marks to enhance the overall look of the video.

Benefits and uses

3D motion tracking is more effective than 2D in the way that it utilises multiple aspects of perspective and rotation of an image in a shot. It can be used to replace images as a whole, to add effects or to display information within video footage that would not necessarily be possible with 2D motion tracking. This could be very beneficial in cinema during post-production to alter elements within the film, e.g. a mythical creature in a fantasy story. I could use this concept for my own personal project if I wanted to change the weather in a shot for example, or to add in images that relate to my personality and creative ideas.

Disadvantages

In a similar way that 2DMT cannot track objects which are obstructed, 3DMT is not very effective at this either. Only high-contrast objects work well when choosing a place to apply the tracking target, which can be a problem depending on the contrast and quality of the overall footage. Unwanted motion blur is also a possible risk if the footage is shot using a slow shutter speed.

This week in our workshops we discovered how to create and utilise the technology of 2D motion tracking. This was done using Adobe After Effects, although there is other software available which can be used in a similar manner. For convenience I will be shortening the term to ‘2DMT’.

What is 2D Motion Tracking?

2DMT is a type of tracking commonly used for small video projects and moving image manipulation. We experimented with how the technology worked using an example of a moving box in a defined space (as shown in the video below).

As shown in this example, 2DMT is a simple way of layering an image over another image to manipulate its original design. The concept shown in the video demonstrates a static image of a black and white checkered grid replacing one side of the cardboard box. The ‘track motion’ option on Adobe After Effects enables the software to pick out and define key points on an object. This then tracks its movement which creates a ‘path’ within the video, allowing a separate image to be applied. In the case of this example, the tracking points were applied to each corner of the box- the grid image was then linked to this tracking and therefore follows the path and movement of the box face.

Benefits and other uses

2D motion tracking can be very beneficial when making quick and simplistic edits or effects to a video. It can be used to replace signs, to display text onto a piece of paper in shot and for many other similar purposes. Advertising companies and other institutions could use this to create effects in their promotional videos. I could also use 2DMT for my personal video project to display information about myself, or to add visual enhancements for creativity.

Disadvantages

There are a few problems with 2DMT, one of them being the fact that it cannot track an object in shot if there are other obstructions. Another hinderance is that on a two-dimensional basis, motion tracking can only perceive movement on the X and Y axis- the Z axis cannot be traced in 2D which can cause problems if a particular image in the frame protrudes through this line. If the Z axis is to be used in a video then 3D motion tracking is needed to be able to detect this. Thirdly, tracking points only work effectively on an image that has high contrast points- in this particular instance the box works well because it provides a high contrast compared to the background footage. This can cause problems if the footage being used includes colours that are quite ‘flat’ or similar to each other, which risks the tracking points being lost as the object moves within the shot. Finally, 2DMT can become an issue if the footage being used was shot at a slow shutter speed. Although this can still track motion correctly the majority of the time, it can cause motion blur which can be distracting or create unwanted visuals.

This week we were looking at the basics of Augmented Reality. More commonly abbreviated as AR, the concept is continually growing and expanding towards public usage. First developed in 1990 by Professor Tom Caudell, AR has become increasingly relevant to the way we use technology both in our home, schools, workplaces etc.

How does it work?

The simplest type of Augmented Reality is one that is commonly used on apps (such as Augment) for mobile phones and other similar hardware. Augment uses printable ‘trackers’ that the user can place in an open area and have their CGI model displayed onto them. Augment in particular allows users to customise their own trackers, print out a pre-developed design or to scan an object that will become a tracker temporarily. The below images are rough demonstrations of how the application works.

The first image of the helicopter model is an example using one of Augment’s pre-developed trackers that I printed. By projecting my mobile phone in the direction of the A4 tracker after having selected the model, the app ‘picks up’ the design and uses it as a surface to display the helicopter on top. The second image is an example of using a temporary tracker to display the Pikachu model- my notebook suffices as a tracker as the shape and size is suitable to allow 3D models to be shown.

What are the benefits?

Although Augmented Reality is still in development, it has proved to be useful in both a creative and practical sense. Museums have been able to enhance their materials on display by using similar tracking points to show 3D models in addition to real-world objects. It gives users a new insight into how they are able to watch, read and learn about history and culture. AR can also be used for educational purposes, i.e. architecture students can model and view their building elements in real-time on a small and convenient scale. Medical students can be shown a display of the human body in a more intricate and reflective design compared to a 2D textbook image. Another use that has been revised recently is for customers shopping for new furniture in their home- AR models of a sofa can be projected into their living room, allowing them to gain a rough idea of what the overall look will be before purchase, for example. Finally, I could use AR in my own project to display models of things that relate to me or describe my personality.

 Are there any flaws/drawbacks?

Currently, Augmented Reality  is still in a somewhat prototype phase. Looking at the models above, they provide a somewhat detailed image, although they fail in terms of texturing. The technology could be further developed so that 3D models will appear more realistic and less animated. Another problem is that apps such as Augment only allow so much room for the models to be shown on a small scale, which can be inconvenient if a user wanted to display multiple models at a time.

In our workshops this week we explored the idea of Projection Mapping, what it is and how it can be used in various ways. Below is a rough diagram that explains how the concept works on a small scale:

This is a basic example of how images and video can be projected onto various types of architecture. The computer software (such as HeavyM and Madmapper) is used to create shapes, designs, animations etc. before being fed into a projector and displayed on a surface. Sound can also be integrated so that items will react to music for example.

What are the possible uses?

As of current, projection mapping seems to be used purely for artistic experiment and technological advances. However, it could potentially go on to be used for educational purposes such as in primary school classrooms. It could also be used for medical reasons such as benefiting people’s mental health, by using the software to create therapeutic sessions (providing it is linked with professional methods of medical procedure). Industries may also benefit from this software as it will allow them to advertise their products in a new and innovative design; simultaneously being able to reach out easily to their target audience.

Disadvantages

Although projection mapping has its advantages, it also has its weak points. There are typical issues of health and safety which could affect people with photosensitive eyesight for example. It could also be dangerous in creating a distraction on buildings to traffic, aircraft and even pedestrians. The technology itself is also currently limited in terms of the types of surfaces it can be projected onto, as well as its visual quality.

Use in own project

For my personal project, projection mapping could be useful in enhancing the visuals used in the video. It would allow me to display my inner thoughts in a creative manner, for example showing phrases and images onto a brick wall as I walk past.