Revision as of 00:20, 28 February 2021 editJoe0824 (talk | contribs)256 editsNo edit summaryTags: Reverted Visual edit← Previous edit | Latest revision as of 08:37, 24 May 2024 edit undoHeadbomb (talk | contribs)Edit filter managers, Autopatrolled, Extended confirmed users, Page movers, File movers, New page reviewers, Pending changes reviewers, Rollbackers, Template editors453,736 edits |doi-access=free | ||
(75 intermediate revisions by 36 users not shown) | |||
Line 1: | Line 1: | ||
{{Short description|Mental ability to track moving objects with attention}} | |||
{{Multiple issues| | |||
{{For|object tracking by computers|Video tracking}} | |||
{{Underlinked|date=November 2020}} | |||
In ] and ], '''multiple object tracking''' ('''MOT''') refers to the ability of humans and other animals to simultaneously monitor multiple objects as they move. It is also the term for certain laboratory techniques used to study this ability. | |||
{{Orphan|date=November 2020}} | |||
}} | |||
In an MOT study, several identical moving objects are presented on a display. Some of the objects are designated as targets while the rest serve as 'distractors'. The study participants try to monitor the changing positions of the targets as they and the distractions move about. At the end of the trial, typically the participants are asked to indicate the final positions of the targets. | |||
'''Multiple object tracking''', or '''MOT''', is a versatile experimental ] developed by ] for studying sustained visual attention in a dynamic environment in 1988.<ref name="Pylyshyn" /> It was first developed in order to support ] (FINST theory). MOT was then commonly used as an experimental technique in order to study how our visual system tracks multiple moving objects. Dozens or perhaps hundreds of modified MOT experiments have been conducted as a continuous attention-demanding task to further understanding human's visual and cognitive function. | |||
The results of MOT experiments have revealed limitations on humans' ability to simultaneously monitor multiple moving objects. For example, awareness of features such as ] and shape is disrupted by the objects' movement. | |||
==Overview== | |||
=== Visual Indexing Theory === | |||
Multiple object tracking was first developed in 1988 by Zenon Pylyshyn in order to support ].<ref name="Pylyshyn">{{cite journal |last1=Pylyshyn |first1=Z. W. |last2=Storm |first2=R. W. |title=Tracking multiple independent targets: Evidence for a parallel tracking mechanism |journal=Spatial Vision |date=1988 |volume=3 |issue=3 |pages=179–197|doi=10.1163/156856888X00122 }}</ref> Visual indexing theory proposes a ] that includes a set of indexes that can be associated with a visible object in the environment, and each index retains its association with an object even when that object moves or changes appearance.<ref>{{cite journal |last1=Fencsik |first1=D. E. |last2=Klieger |first2=S. B. |last3=Horowitz |first3=T. S. |title=The role of location and motion information in the tracking and recovery of moving objects |journal=Perception & Psychophysics |date=2007 |volume=69 |issue=4 |pages=567–577|doi=10.3758/BF03193914 |doi-access=free }}</ref> | |||
Visual indexing theory is also called FINST theory, which abbreviates ‘fingers of instantiation’. Pylyshyn uses the analogy of fingers as indexes in this theory.<ref>{{cite journal |last1=Pylyshyn |first1=Z. |title=The role of location indexes in spatial perception: A sketch of the FINST spatial-index model |journal=Cognition |date=1989 |volume=32 |issue=1 |pages=65–97|doi=10.1016/0010-0277(89)90014-0 }}</ref> If a person were to put his fingers on five different objects, and when the objects change location, the fingers still stay in contact with each object respectively. In other words, analogous to fingers attaching to objects, visual indexing theory suggests that individual objects have a small number of indexes that are also attached to them. These indexes obtain unique relational properties to the objects, and are independent when the objects change locations, thus allowing these objects to be tracked when their locations move. | |||
==Background== | |||
=== Development of multiple object tracking task === | |||
=== History === | |||
MOT task is an attentional paradigm that is developed with several unique features in mind in order to test visual indexing theory. When MOT task was first designed, the researchers aimed to study how successfully humans were able to keep track of several moving objects, therefore these unique features are: | |||
In the 1970s, researcher ] postulated the existence of a "primitive visual process" in the human brain capable of "indexing and tracking features or feature-clusters". Using this process, ] can continuously refer to, or "track", objects despite movement of the objects causing them to stimulate different visual ]s over time.<ref name="Pylyshyn">{{cite journal|last1=Pylyshyn|first1=Z. W.|last2=Storm|first2=R. W.|date=1988|title=Tracking multiple independent targets: Evidence for a parallel tracking mechanism|journal=Spatial Vision|volume=3|issue=3|pages=179–197|doi=10.1163/156856888X00122|pmid=3153671 |s2cid=1433436 }}</ref> Data collected with Pylyshyn's MOT protocol and published in 1988 provided the first formal demonstration that the mind can keep track of the changing positions of multiple moving objects.<ref name="Pylyshyn" /> | |||
*First, unlike many other paradigms that only require participant's brief attentional shifts, MOT task requires continuous sustained ] for a prolonged period of time.<ref name="Alv">{{cite journal |last1=Alvarez |first1=G.A. |last2=Scholl |first2=B.J. |title=How does attention select and track spatially extended objects? New effects of attentional concentration and amplification |journal=Journal of Experimental Psychology: General |date=2005 |volume=134 |issue=4 |page=461|doi=10.1037/0096-3445.134.4.461 }}</ref> | |||
*Second, MOT task involves multiple objects to be tracked instead of focal attention on one target.<ref name="Alv"/> | |||
*Third, MOT task allows researchers to look at many aspects of visual attention, including selectivity, capacity limitation, sustained processing effort, etc.<ref name="Styr">{{cite journal |last1=Styrkowiec |first1=P. |last2=Chrzanowska |first2=A. |title=Higher visuo-Attentional Demands of Multiple Object Tracking (MOT) Lead to A Lower Precision in Pointing Movements |journal=The Journal of General Psychology |date=2018 |volume=145 |issue=2 |pages=134–152 |doi=10.1080/00221309.2018.1437385 |pmid=29558270 }}</ref> | |||
*Lastly, another key feature is that MOT task is able demonstrate that our visual attention is spatially divided.<ref name="Scholl 2009">{{cite journal |last1=Scholl |first1=B.J |title=What have we learned about attention from multiple object tracking (and vice versa) |journal=Computation, Cognition, and Pylyshyn |date=2009 |pages=49–78}}</ref> | |||
As a specific theory of this ability, Pylyshyn proposed ] (FINST), which claims that tracking is mediated by a fixed set of discrete pointers. While FINST theory has been very influential, many studies have found evidence that seems inconsistent with the theory.<ref name="Scholl08">{{cite book|last1=Scholl|first1=Brian J. | date=2008|title=Computation, cognition, and Pylyshyn | chapter=What Have We Learned about Attention from Multiple-Object Tracking (and Vice Versa)? | publisher=MIT Press | pages=49–78|doi=10.7551/mitpress/8135.003.0005|editor1-first=Don|editor1-last= Dedrick|editor2-first= Lana|editor2-last= Trick|isbn=9780262255196}}</ref> | |||
Originally created to as a continuous attention demanding task in order to test the FINST theory, MOT task has been adopted and modified by many laboratories all over the globe and used in various ways. | |||
==Procedure== | === Procedure === | ||
] | |||
A typical MOT study involves the presentation of between eight and twelve objects. The participant is told to monitor the positions of a ] of the objects, which are referred to as targets. Often the targets are indicated by being presented initially in a distinct color. The targets then become identical in appearance to the other, distractor objects. The targets and distractors move about the screen for several seconds in an unpredictable fashion. The participant is then asked to indicate which of the objects are the targets. The accuracy of the participant's judgments indicates whether the participant mentally updated the positions of the targets as they moved. | |||
] | |||
To ensure that the task requires participants to mentally update the targets' positions, displays are typically designed such that object paths cause the targets to swap positions with distractors, at least occasionally. With that constraint, MOT task variations have been designed to probe specific aspects of how the mind tracks moving objects. For example, to compare performance in the left to performance in the right ]s, studies confine some or all the moving objects to one of the visual fields.<ref>{{Cite journal|last1=Edwards|first1=Grace|last2=Berestova|first2=Anna|last3=Battelli|first3=Lorella|date=2021-09-29|title=Behavioral gain following isolation of attention|journal=Scientific Reports|language=en|volume=11|issue=1|pages=19329|doi=10.1038/s41598-021-98670-w|issn=2045-2322|pmc=8481494|pmid=34588526|bibcode=2021NatSR..1119329E }}</ref> To avoid any contribution from spatial interference among mental object representations, some studies maintain a minimum distance between objects.<ref name=":22">{{Cite journal|last1=Holcombe|first1=A. O.|last2=Chen|first2=W.- Y.|last3=Howe|first3=P. D. L.|date=2014-08-01|title=Object tracking: Absence of long-range spatial interference supports resource theories|journal=Journal of Vision|language=en|volume=14|issue=6|pages=1|doi=10.1167/14.6.1|pmid=25086084 |issn=1534-7362|doi-access=free}}</ref> Other studies have combined MOT with a concurrent task to investigate whether the two tasks draw on the same mental resource, and have changed target features such as color to assess whether study participants update their representations of those features. | |||
=== Typical MOT task === | |||
During a most typical MOT task, eight identical items, usually filled circles, are presented to a participant in the beginning of the task, as shown on the figure above. Some of the items will be highlighted for a short period of time (by ] or changing color) indicating that they are the targets to be tracked by the participant (a). Then after the targets reverting to the identical state, all items will start moving around unpredictably, bumping into each other or the boarder (b). After a short period of time, these items will stop moving simultaneously. The participant then is asked either to identify all targets (full report) by clicking on the targets (c) or to identify if one specified item is one of the targets (partial report).<ref name="walle 2019">{{cite journal |last1=Walle |first1=K. M. |last2=Nordvik |first2=J. E. |last3=Espeseth |first3=T. |last4=Becker |first4=F. |last5=Laeng |first5=B. |title=Multiple object tracking and pupillometry reveal deficits in both selective and intensive attention in unilateral spatial neglect |journal=Journal of Clinical and Experimental Neuropsychology |date=2019 |volume=41 |issue=3 |pages=270–289 |doi=10.1080/13803395.2018.1536735 |pmid=30426866 }}</ref> | |||
== {{Anchor|Capacity limits}}Capacity limits == | |||
=== Modification === | |||
Typical MOT task itself is quite straightforward, the most central result in the experiment conducted by Pylyshyn in 1988 is that it is possible for humans to keep track of multiple moving objects. However, the strength of MOT task lies in its versatility.<ref name="Wang 2018">{{cite journal |last1=Wang |first1=C. |last2=Hu. |first2=L. |last3=Hu. |first3=S. |last4=Xu |first4=Y. |last5=Zhang |first5=X. |title=Functional specialization for feature-based and symmetry-based groupings in multiple object tracking |journal=Cortex |date=2018 |volume=108 |pages=265–275 |doi=10.1016/j.cortex.2018.09.005 |pmid=30296615 }}</ref> | |||
MOT study results indicate that the number of targets that people can track is very limited. This reflects a ] in the brain's processing architecture. While at the early, sensory stages of visual processing, dozens of objects may be fully processed, later processes such as those associated with cognition have much more limited capacity to process visual objects.<ref>{{Cite book|title=Attending to moving objects|last=Holcombe|first=Alex O.|publisher=Cambridge University Press|year=2023|at=Section 2|doi=10.1017/9781009003414|isbn=9781009003414|s2cid=256170538 |url=https://psyarxiv.com/c75x4/ }}</ref> | |||
By manipulating properties such as the color, shape of the moving target, or by changing the direction or speed of the movement of them, MOT task can become an entirely new attentional task to study many other aspects of cognitive and visual system, such as grouping effect, spatial memory, task switching, spatial resolution, visual occlusion, etc. More generally, MOT has been used as a paradigm to study the operation of attention in many different populations including children with autism spectrum disorder, etc.<ref name="Scholl 2009" /> | |||
The specific number of visual objects that people can accurately track varies widely with display parameters, contrary to a common belief that people can track no more than four or five objects. Even for a fixed set of display parameters, rather than there being a clear limit, performance falls gradually with the number of targets.{{sfn|Holcombe|2023|loc=Section 3}} Such findings undermine Pylyshyn's FINST theory that tracking is mediated by a fixed set of discrete pointers.<ref>{{Cite journal|last1=Alvarez|first1=George A.|last2=Franconeri|first2=Steven L.|date=2007-10-30|title=How many objects can you track?: Evidence for a resource-limited attentive tracking mechanism|journal=Journal of Vision|language=en|volume=7|issue=13|pages=14.1–10|doi=10.1167/7.13.14|pmid=17997642 |issn=1534-7362|doi-access=free}}</ref> | |||
==Significant findings== | |||
The above limitations appear to stem from processes specific to the two ]s. The independence of the limits in the two ] is demonstrated by findings that when one is tracking the maximum number that can be tracked in the left hemifield (which is processed by the right cerebral hemisphere), one can add targets to the right hemifield (which is processed by the left cerebral hemisphere) at little to no cost to performance.<ref>{{Cite journal|last1=Alvarez|first1=George A.|last2=Cavanagh|first2=Patrick|date=August 2005|title=Independent Resources for Attentional Tracking in the Left and Right Visual Hemifields|url=http://journals.sagepub.com/doi/10.1111/j.1467-9280.2005.01587.x|journal=Psychological Science|language=en|volume=16|issue=8|pages=637–643|doi=10.1111/j.1467-9280.2005.01587.x|pmid=16102067 |s2cid=590734 |issn=0956-7976}}</ref><ref name=":1">{{Cite journal|last1=Holcombe|first1=Alex O.|last2=Chen|first2=Wei-Ying|date=May 2012|title=Exhausting attentional tracking resources with a single fast-moving object|url=https://linkinghub.elsevier.com/retrieve/pii/S0010027711002459|journal=Cognition|language=en|volume=123|issue=2|pages=218–228|doi=10.1016/j.cognition.2011.10.003|pmid=22055340 |hdl=2123/7868 |s2cid=20494664 |hdl-access=free}}</ref> For features other than position, capacity seems to be more limited—''see ]''. | |||
'''Some unique properties of MOT tasks:''' | |||
While the tracking capacity limit is largely set separately by the two cerebral hemispheres, a more unified and cognitive resource also can contribute to tracking. For example, if there is only one target, one can bring one's full cognitive abilities to bear, such as in predicting future positions, to facilitate tracking. When more targets are present, these resources may still play a role.{{sfn|Holcombe|2023|loc=Section 6}} | |||
* Up to a maximum of 5 moving objects can be tracked successfully out of 10 total objects, as a typical MOT task shows.<ref name="Pylyshyn" /> However, this capacity may be changed based on the speed of the moving targets. Up to 8 moving targets can be tracked if they are moving at a relatively low speed, while only 1 target can be tracked if they are moving at a high speed.<ref name="Alv 2007">{{cite journal |last1=Alvarez |first1=G.A. |last2=Franconeri |first2=S.L. |title=How many objects can you track?: Evidence for a resource-limited attentive tracking mechanism |journal=Journal of Vision |date=2007 |volume=7 |issue=13 |page=14|doi=10.1167/7.13.14 |pmid=17997642 |doi-access=free }}</ref> | |||
* Moving objects are still being tracked when they are behind an occluder. Under certain situations, they also can be tracked even if all targets disappear together for a very brief amount of time.<ref name="Scholl 1999">{{cite journal |last1=Scholl |first1=B.J. |last2=Pylyshyn |first2=Z.W. |title=Tracking multiple items through occlusion: Clues to visual objecthood |journal=Cognitive Psychology |date=1999 |volume=38 |issue=2 |pages=259–90 |doi=10.1006/cogp.1998.0698 |pmid=10090804 }}</ref> | |||
* A person is able to complete two MOT tasks simultaneously if the targets are presented to the participant in separate hemifields. In other words, participant is able to track twice as many moving objects if the objects are divided between the left and right hemifields.<ref name="Alv 2004">{{cite journal |last1=Alvarez |first1=G.A. |last2=Cavanagh |first2=P. |title=Independent attention resources for the left and right visual hemifields |journal=Journal of Vision |date=2004 |volume=4 |issue=8 |page=29|doi=10.1167/4.8.29 |doi-access=free }}</ref> | |||
* The properties of moving targets are not relevant to the performance of MOT task.<ref name="Scholl 1999" /> Also participants have a very hard time to detect any property change of the targets during a mot task. In other words, even when targets are successfully tracked, participants can still have trouble recalling any color or shape change during the moving phase.<ref name="Bahrami 2003">{{cite journal |last1=Bahrami |first1=B. |title=Object property encoding and change blindness in multiple object tracking |journal=Visual Cognition |date=2003 |volume=10 |issue=8 |pages=949–963|doi=10.1080/13506280344000158 }}</ref> | |||
== {{Anchor|Spatiotemporal limits}}Spatiotemporal limits == | |||
'''MOT task study among different populations:''' | |||
If the objects of a display are not sufficiently widely spaced, the objects are difficult to identify and select with attention due to ], which can prevent tracking.<ref name=":22" /><ref name=":17">{{Cite journal|last1=Intriligator|first1=James|last2=Cavanagh|first2=Patrick|date=November 2001|title=The Spatial Resolution of Visual Attention|url=https://linkinghub.elsevier.com/retrieve/pii/S0010028501907558|journal=Cognitive Psychology|language=en|volume=43|issue=3|pages=171–216|doi=10.1006/cogp.2001.0755|pmid=11689021 |s2cid=18050760 }}</ref> High object speeds have a similar effect—faster objects are harder to track, and humans are completely unable to track objects that move sufficiently fast. This "speed limit", however, is much slower than the maximum object speed at which humans can judge the object's movement direction.<ref name=":1" /><ref name=":2">{{Cite journal|last1=Verstraten|first1=Frans A.J|last2=Cavanagh|first2=Patrick|last3=Labianca|first3=Angela T|date=December 2000|title=Limits of attentive tracking reveal temporal properties of attention|journal=Vision Research|language=en|volume=40|issue=26|pages=3651–3664|doi=10.1016/S0042-6989(00)00213-3|pmid=11116167 |s2cid=12270476 |doi-access=free}}</ref> This dissociation between motion perception and object tracking is thought to reflect that direction judgments can be based on low-level and local motion detector responses that do not register the positions of objects. | |||
* MOT capacity can also be increased with training. Action video game players can perform better on MOT tasks, tracking more targets successfully compare to non-video game players.<ref name="Eichen 2014">{{cite journal |last1=Eichenbaum |first1=A. |last2=Bavelier |first2=D. |last3=Green |first3=C.S. |title=Video games: Play that can do serious good |journal=American Journal of Play |date=2014 |volume=7 |issue=1 |pages=50–72}}</ref> Radar operators can also perform really well on MOT tasks without much task specific training.<ref name="Allen 2004">{{cite journal |last1=Allen |first1=R. |last2=Mcgeorge |first2=P. |last3=Pearson |first3=D. |last4=Milne |first4=A. B. |title=Attention and expertise in multiple target tracking |journal=Applied Cognitive Psychology |date=2004 |volume=18 |issue=3 |pages=337–347|doi=10.1002/acp.975 }}</ref> | |||
* Children with autism spectrum disorder perform worse on MOT task compare to healthy children. Studies have suggested that children with autism may suffer from attentional deficits issues, therefore impacting the overall MOTtask performance.<ref name="Ohearn 2013">{{cite journal |last1=O'hearn |first1=K. |last2=Franconeri |first2=S. |last3=Wright |first3=C. |last4=Minshew |first4=N. |last5=Luna |first5=B. |title=The development of individuation in autism |journal=Journal of Experimental Psychology: Human Perception and Performance |date=2013 |volume=39 |issue=2 |pages=494–509 |doi=10.1037/a0029400 |pmid=22963232 |pmc=3608798 }}</ref> | |||
* Compare to non-athletes, basketball players also perform much better on MOT task, suggesting that basketball players have high cognitive functions at allocating resources to multiple targets while inhibiting identical looking distractors.<ref name="Qiu 2019">{{cite journal |last1=Qiu |first1=F. |last2=Pi |first2=Y. |last3=Liu |first3=K. |last4=Zhu |first4=H. |last5=Li |first5=X. |last6=Zhang |first6=J. |last7=Wu |first7=Y. |title=Neural efficiency in basketball players is associated with bidirectional reductions in cortical activation and deactivation during multiple-object tracking task performance |journal=Biological Psychology |date=2019}}</ref> | |||
* Out of the three groups (child group age 7– 12 years old, adult group age 18–40 years old, and older adult group age 65 years and older), Adult group have the best MOT task performance, followed by child group. Older adult performed the worst among the three groups. It is suggested that stereopsis, the ability to perceive depth, helps children and adults accomplish MOT task more successfully, but has no impact on older adults.<ref name="Plourde 2017">{{cite journal |last1=Plourde |first1=M. |last2=Corbeil |first2=M. E. |last3=Faubert |first3=J. |title=Effect of age and stereopsis on a multiple-object tracking task |journal=PLOS ONE |date=2017 |volume=12 |issue=12 |page=e0188373|doi=10.1371/journal.pone.0188373 |pmid=29244875 |bibcode=2017PLoSO..1288373P |pmc=5731704 }}</ref> | |||
As an object's speed is increased, temporal crowding can result and prevent tracking well before the tracking speed limit is reached.<ref name=":2" /><ref name=":13">{{Cite journal|last1=Holcombe|first1=A. O.|last2=Chen|first2=W.-Y.|date=2013-01-09|title=Splitting attention reduces temporal resolution from 7 Hz for tracking one object to|journal=Journal of Vision|language=en|volume=13|issue=1|pages=12|doi=10.1167/13.1.12|pmid=23302215 |issn=1534-7362|doi-access=free}}</ref> Temporal crowding refers to an impairment caused by distractors visiting a target's former location within a short interval. The phenomenon was revealed in a study with a display where distractors were evenly-spaced along a circular trajectory that was also shared by a target. Participants could not track three targets if the locations traversed were visited by objects more than three times per second, and this was true even if the objects were moving at a relatively slow speed. This temporal crowding limit on tracking becomes more severe as the number of targets increases.<ref name=":13" /><ref name=":14">{{Cite journal|last1=Roudaia|first1=Eugenie|last2=Faubert|first2=Jocelyn|date=2017-09-01|title=Different effects of aging and gender on the temporal resolution in attentional tracking|journal=Journal of Vision|language=en|volume=17|issue=11|pages=1|doi=10.1167/17.11.1|pmid=28862709 |issn=1534-7362|doi-access=free}}</ref> | |||
==References== | |||
{{reflist|2}} | |||
As the spatial, temporal, and speed limits are approached, tracking performance decreases gradually<ref name=":17" /><ref name=":13" /> and in typical MOT displays, it is unclear which of these limits, or what combination of them, determine the maximum number of targets that can be tracked.{{sfn|Holcombe|2023|loc=Section 4}} For the spatial limit, one study found little to no effect beyond the ] crowding zone.<ref name=":22"/> Many MOT studies do not enforce sufficient spacing between objects to avoid spatial crowding, making spatial crowding likely to be one factor in overall performance. | |||
== Role of prediction and trajectory information == | |||
Brains continuously predict some aspects of the future.<ref>{{Cite book|url=https://www.worldcat.org/oclc/904011681|title=Surfing uncertainty: Prediction, action, and the embodied mind|last=Clark|first=Andy|date=2016|isbn=978-0-19-021701-3|location=Oxford|oclc=904011681|doi=10.1093/acprof:oso/9780190217013.001.0001}}</ref><ref>{{Cite book|url=https://www.worldcat.org/oclc/868923880|title=The predictive mind|last=Hohwy|first=Jakob|date=2013|isbn=978-0-19-150519-5|edition=First |location=Oxford|oclc=868923880|doi=10.1093/acprof:oso/9780199682737.001.0001}}</ref> In the case of multiple object tracking, however, several MOT studies have found evidence against extrapolation of future positions.<ref>{{Cite journal |last1=Franconeri |first1=Steven L. |last2=Pylyshyn |first2=Zenon W. |last3=Scholl |first3=Brian J. |date=May 2012 |title=A simple proximity heuristic allows tracking of multiple objects through occlusion |journal=Attention, Perception, & Psychophysics |language=en |volume=74 |issue=4 |pages=691–702 |doi=10.3758/s13414-011-0265-9 |pmid=22271165 |s2cid=256119018 |issn=1943-3921|doi-access=free }}</ref><ref>{{Cite journal |last1=Keane |first1=B |last2=Pylyshyn |first2=Z |date=June 2006 |title=Is motion extrapolation employed in multiple object tracking? Tracking as a low-level, non-predictive function☆ |url=https://linkinghub.elsevier.com/retrieve/pii/S0010028505001027 |journal=Cognitive Psychology |language=en |volume=52 |issue=4 |pages=346–368 |doi=10.1016/j.cogpsych.2005.12.001|pmid=16442088 |s2cid=5771001 }}</ref><ref>{{Cite journal |last1=Howard |first1=Christina J. |last2=Masom |first2=David |last3=Holcombe |first3=Alex O. |date=September 2011 |title=Position representations lag behind targets in multiple object tracking |journal=Vision Research |language=en |volume=51 |issue=17 |pages=1907–1919 |doi=10.1016/j.visres.2011.07.001|pmid=21762715 |s2cid=14555811 |doi-access=free }}</ref><ref>{{Cite journal |last1=Howard |first1=Christina J. |last2=Holcombe |first2=Alex O. |date=April 2008 |title=Tracking the changing features of multiple objects: Progressively poorer perceptual precision and progressively greater perceptual lag |journal=Vision Research |language=en |volume=48 |issue=9 |pages=1164–1180 |doi=10.1016/j.visres.2008.01.023|pmid=18359501 |s2cid=8485280 |doi-access=free }}</ref><ref name=":28">{{Cite journal |last1=Fencsik |first1=David E. |last2=Klieger |first2=Sarah B. |last3=Horowitz |first3=Todd S. |date=May 2007 |title=The role of location and motion information in the tracking and recovery of moving objects |journal=Perception & Psychophysics |language=en |volume=69 |issue=4 |pages=567–577 |doi=10.3758/BF03193914 |pmid=17727110 |s2cid=24515387 |issn=0031-5117|doi-access=free }}</ref> | |||
When future positions are predictable, human object tracking performance can be higher than when future positions are unpredictable. However, the benefit seems to disappear when there are more than one or two targets,<ref name=":26">{{Cite journal|last1=Howe|first1=P. D. L.|last2=Holcombe|first2=A. O.|date=2012-12-10|title=Motion information is sometimes used as an aid to the visual tracking of objects|journal=Journal of Vision|language=en|volume=12|issue=13|pages=10|doi=10.1167/12.13.10|pmid=23232339 |issn=1534-7362|doi-access=free}}</ref><ref name=":27">{{Cite journal|last1=Luu|first1=Tina|last2=Howe|first2=Piers D. L.|date=August 2015|title=Extrapolation occurs in multiple object tracking when eye movements are controlled|journal=Attention, Perception, & Psychophysics|language=en|volume=77|issue=6|pages=1919–1929|doi=10.3758/s13414-015-0891-8|pmid=25893469 |s2cid=256207631 |issn=1943-3921|doi-access=free}}</ref><ref name=":28" /> suggesting that any prediction happening is more limited in processing capacity than other aspects of object tracking. One issue with those studies, however, it that predictability of objects' future positions appears to be confounded with the objects being distinguishable from each other (on the basis of maintaining particular and different motion directions). In such experiments, the difference in targets' and distractors' motion directions or accelerations may be the facilitator of tracking rather than prediction of future positions.<ref name=":12">{{Cite journal|last1=Wang|first1=Yang|last2=Vul|first2=Edward|date=2021-03-26|title=The role of kinematic properties in multiple object tracking|url=https://jov.arvojournals.org/article.aspx?articleid=2772432|journal=Journal of Vision|language=en|volume=21|issue=3|pages=22|doi=10.1167/jov.21.3.22|pmid=33769442 |pmc=7998010 |issn=1534-7362}}</ref> Indeed, distinctiveness of motion directions alone facilitates tracking.<ref name=":12" /> Ability to detect a change in a target's trajectory is much worse with each increase in target number. This suggests motion direction is only utilized when there are few targets,<ref>{{Cite journal|last1=Tripathy|first1=Srimant P.|last2=Barrett|first2=Brendan T.|date=2004-12-09|title=Severe loss of positional information when detecting deviations in multiple trajectories|journal=Journal of Vision|volume=4|issue=12|pages=1020–1043|doi=10.1167/4.12.4|pmid=15669909 |issn=1534-7362|doi-access=free}}</ref> and may explain why the predictability benefit is confined to when there are only a few targets.<ref name=":26" /><ref name=":27" /> | |||
== Role of grouping and coordinate frames == | |||
The human brain represents the positions of objects with multiple reference frames or coordinate systems. Early stages of the visual system represent the locations of objects relative to the direction the eyes are pointing (]). Some later stages of human visual processing can represent object locations relative to each other or to the scene. | |||
Regarding representation of relative locations, the relative positions of objects can be represented with an imaginary ], with each target a different vertex of that polygon. In studies of MOT, Steve Yantis drew participants' attention to the polygon formed by the targets and found that benefited performance,<ref>{{Cite journal|last=Yantis|first=Steven|date=July 1992|title=Multielement visual tracking: Attention and perceptual organization|journal=Cognitive Psychology|language=en|volume=24|issue=3|pages=295–340|doi=10.1016/0010-0285(92)90010-Y|pmid=1516359 |s2cid=974635 |doi-access=free}}</ref> as did setting the targets' trajectories to avoid much disruption of the constantly-morphing polygon. This suggests that shape tracking contributes to accurate performance, at least in some participants.<ref>{{Cite journal|last1=Merkel|first1=Christian|last2=Stoppel|first2=Christian M.|last3=Hillyard|first3=Steven A.|last4=Heinze|first4=Hans-Jochen|last5=Hopf|first5=Jens-Max|last6=Schoenfeld|first6=Mircea Ariel|date=2014-01-01|title=Spatio-temporal Patterns of Brain Activity Distinguish Strategies of Multiple-object Tracking|url=https://direct.mit.edu/jocn/article/26/1/28/28040/Spatio-temporal-Patterns-of-Brain-Activity|journal=Journal of Cognitive Neuroscience|language=en|volume=26|issue=1|pages=28–40|doi=10.1162/jocn_a_00455|pmid=23915053 |s2cid=11744449 |issn=0898-929X}}</ref> One study measured an electrical brain response (]) to a probe that was flashed while the objects were moving. The earliest-detectable part of the neural response to the probe was significantly greater if the probe lay on the polygon defined by the targets rather than inside or outside the polygon.<ref>{{Cite journal|last1=Merkel|first1=Christian|last2=Hopf|first2=Jens-Max|last3=Schoenfeld|first3=Mircea Ariel|date=February 2017|title=Spatio-temporal dynamics of attentional selection stages during multiple object tracking|url=https://linkinghub.elsevier.com/retrieve/pii/S1053811916306024|journal=NeuroImage|language=en|volume=146|pages=484–491|doi=10.1016/j.neuroimage.2016.10.046|pmid=27810524 |s2cid=3389532 }}</ref> This suggests that at least some of the participants continuously tracked the polygon defined by the targets. | |||
Displays with more complicated statistical relationships among moving targets have been devised to show that regularities in ] relationships are extracted and utilized in multiple object tracking, including nesting of groups of objects within moving reference frames.<ref>{{Cite journal|last1=Bill|first1=Johannes|last2=Pailian|first2=Hrag|last3=Gershman|first3=Samuel J.|last4=Drugowitsch|first4=Jan|date=2020-09-29|title=Hierarchical structure is employed by humans during visual motion perception|journal=Proceedings of the National Academy of Sciences|language=en|volume=117|issue=39|pages=24581–24589|doi=10.1073/pnas.2008961117|issn=0027-8424|pmc=7533882|pmid=32938799 |bibcode=2020PNAS..11724581B |doi-access=free }}</ref> | |||
== {{Anchor|Updating of features other than position}}Updating of features other than position == | |||
The classic MOT task requires updating of targets' positions but not their other features. People appear to be less able to update the other features of targets, and have difficulty even in maintaining their knowledge of such features as the associated objects move. In one study, ] assigned distinct identities to four identical targets, either by giving them names or by giving them easily-identifiable starting positions: the four corners of the screen. In addition to the usual task at the end of the trial of identifying which objects were the targets, participants also were asked about the identity of the targets – which one each was. Contrary to what Pylyshyn expected from his FINST theory, accuracy at identifying which target was which was very low, even when accuracy reporting the targets' positions was high.<ref>{{Cite journal|last=Pylyshyn|first=Zenon|date=October 2004|title=Some puzzling findings in multiple object tracking: I. Tracking without keeping track of object identities|url=http://www.tandfonline.com/doi/full/10.1080/13506280344000518|journal=Visual Cognition|language=en|volume=11|issue=7|pages=801–822|doi=10.1080/13506280344000518|s2cid=14717612 |issn=1350-6285}}</ref> | |||
To assess maintenance of knowledge of object identities, one series of experiments used cartoon animals as targets and distractors that all moved about the screen. By the end of each trial, the animals came to rest behind cartoons of ], so that their identities were no longer visible. Participants were asked where a particular target (e.g., the cartoon rabbit) had gone—that is, which occluder it was hiding behind. In this multiple identity tracking (MIT) task, performance was much worse than in the standard MOT task of reporting target locations irrespective of which target a location belonged to.<ref>{{Cite journal|last1=Horowitz|first1=Todd S.|last2=Klieger|first2=Sarah B.|last3=Fencsik|first3=David E.|last4=Yang|first4=Kevin K.|last5=Alvarez|first5=George A.|last6=Wolfe|first6=Jeremy M.|date=February 2007|title=Tracking unique objects|journal=Perception & Psychophysics|language=en|volume=69|issue=2|pages=172–184|doi=10.3758/BF03193740|pmid=17557588 |s2cid=8138353 |issn=0031-5117|doi-access=free}}</ref> | |||
The deficit in updating the locations of featural and identity information may reflect a more general deficit in updating the locations of objects in ]. In a study using a ] in which the shells hid brightly-colored balls of wool, pairs of shells were swapped at a slow rate of once a second, but accuracy judging which shell contained a particular color fell to 80% accuracy when there were four swaps in a simple three-shell display, compared to 95% accuracy for four swaps with a two-shell display.<ref name=":4">{{Cite journal|last1=Pailian|first1=Hrag|last2=Carey|first2=Susan E.|last3=Halberda|first3=Justin|last4=Pepperberg|first4=Irene M.|date=December 2020|title=Age and Species Comparisons of Visual Mental Manipulation Ability as Evidence for its Development and Evolution|journal=Scientific Reports|language=en|volume=10|issue=1|pages=7689|doi=10.1038/s41598-020-64666-1|issn=2045-2322|pmc=7203154|pmid=32376944|bibcode=2020NatSR..10.7689P }}</ref> | |||
The concept of an "object file" is that of a record in the brain that stores the features of a visual object, with the location record updated as the object moves.<ref name=":16">{{Cite journal|last1=Kahneman|first1=Daniel|last2=Treisman|first2=Anne|last3=Gibbs|first3=Brian J|date=April 1992|title=The reviewing of object files: Object-specific integration of information|url=https://linkinghub.elsevier.com/retrieve/pii/001002859290007O|journal=Cognitive Psychology|language=en|volume=24|issue=2|pages=175–219|doi=10.1016/0010-0285(92)90007-O|pmid=1582172 |s2cid=2688060 }}</ref> In the original studies that were motivated by this idea, one feature an object disappears and the object moves to a new location. The feature is then presented in the new location, and people respond faster to that feature than to features that were not previously presented as part of the object. This finding of priming indicates that an object file was created and updated by the brain. One might expect this to tap into the same processing as that assessed by the MIT task. The relationship between the two is unclear, however, as there is evidence that attentional tracking occurs can occur along a different trajectory than that which is the basis of updating the memory of an object's features.<ref>{{Cite journal|last1=Mitroff|first1=Stephen R.|last2=Scholl|first2=Brian J.|last3=Wynn|first3=Karen|date=May 2005|title=The relationship between object files and conscious perception|url=https://linkinghub.elsevier.com/retrieve/pii/S0010027704001490|journal=Cognition|language=en|volume=96|issue=1|pages=67–92|doi=10.1016/j.cognition.2004.03.008|pmid=15833307 |s2cid=9043690 }}</ref> | |||
In the studies mentioned so far, the objects involved did not change any of their features besides their positions, so the task was to maintain knowledge of (unchanging) features while updating their positions. ] studies show that in many circumstances, people do poorly at noticing that features have changed. A famous demonstration involves placing a blank screen between the presentation of two versions of a screen to mask the flicker that would otherwise be associated with a change. Change blindness also occurs when the flicker evoked by the change is masked by the objects' motion.<ref>{{Cite journal|last1=Saiki|first1=J.|last2=Holcombe|first2=A. O.|date=2012-03-06|title=Blindness to a simultaneous change of all elements in a scene, unless there is a change in summary statistics|journal=Journal of Vision|language=en|volume=12|issue=3|pages=2|doi=10.1167/12.3.2|pmid=22396462 |issn=1534-7362|doi-access=free}}</ref><ref>{{Cite journal|last1=Suchow|first1=Jordan W.|last2=Alvarez|first2=George A.|date=January 2011|title=Motion Silences Awareness of Visual Change|journal=Current Biology|language=en|volume=21|issue=2|pages=140–143|doi=10.1016/j.cub.2010.12.019|pmid=21215632 |s2cid=10500810 |doi-access=free|bibcode=2011CBio...21..140S }}</ref> That, however, may only mean that nothing is comparing the features present before and after the change; it does not necessarily mean that object representations are not updated, so other studies are needed. | |||
A related issue is whether tracking can occur on the basis not only of smooth changes in the position of an object, but also on the basis of smooth changes in an object's other features. In a tracking experiment in which two objects were always spatially superposed, the objects maintained their separate identities based on smooth continuity of their colors, orientations, and ]. The participants could only track one such object,<ref>{{Cite journal|last1=Blaser|first1=Erik|last2=Pylyshyn|first2=Zenon W.|last3=Holcombe|first3=Alex O.|date=November 2000|title=Tracking an object through feature space|url=http://www.nature.com/articles/35041567|journal=Nature|language=en|volume=408|issue=6809|pages=196–199|doi=10.1038/35041567|pmid=11089972 |bibcode=2000Natur.408..196B |s2cid=4418346 |issn=0028-0836}}</ref> suggesting no ability to capitalize on spatiotemporal feature continuity for features other than position, although this has not yet been tested for cases in which the targets do not overlap (overlap may trigger ] interference). | |||
== Difficulty tracking unusual objects and object parts == | |||
Many objects have clearly-visible parts. A ], for example, has a central bar part and has the weights at the bar's ends. Even when such parts are conspicuous, people can have difficulty tracking an individual part of multiple objects. When individual ends of multiple dumbbell-shaped drawings are designated as targets, tracking performance is poor.<ref name=":5">{{Cite journal|last1=Howe|first1=Piers D.|last2=Incledon|first2=Natalie C.|last3=Little|first3=Daniel R.|date=2012-07-30|editor-last=de Fockert|editor-first=Jan|title=Can Attention Be Confined to Just Part of a Moving Object? Revisiting Target-Distractor Merging in Multiple Object Tracking|journal=PLOS ONE|language=en|volume=7|issue=7|pages=e41491|doi=10.1371/journal.pone.0041491|issn=1932-6203|pmc=3408494|pmid=22859990 |bibcode=2012PLoSO...741491H |doi-access=free }}</ref><ref name=":18">{{Cite journal|last1=Scholl|first1=Brian J|last2=Pylyshyn|first2=Zenon W|last3=Feldman|first3=Jacob|date=June 2001|title=What is a visual object? Evidence from target merging in multiple object tracking|url=https://linkinghub.elsevier.com/retrieve/pii/S0010027700001578|journal=Cognition|language=en|volume=80|issue=1–2|pages=159–177|doi=10.1016/S0010-0277(00)00157-8|pmid=11245843 |s2cid=7053492 }}</ref> Performance was even worse when participants attempted to track one end of multiple moving lines, where the lines were uniform without distinct parts. Evidently, the mental processes that underlie tracking of multiple objects operate on a particular type of object representation that differs from what we can consciously recognize. Possibly the representation used for tracking is shared by that used when searching for a particular colored shape that is hidden among many other shapes; ] is hindered by connecting targets to distractors.{{sfn|Holcombe|2023|loc=Section 7.4}}<ref>{{Cite journal|last1=Wolfe|first1=Jeremy M.|last2=Bennett|first2=Sara C.|date=January 1997|title=Preattentive Object Files: Shapeless Bundles of Basic Features|url=https://linkinghub.elsevier.com/retrieve/pii/S0042698996001113|journal=Vision Research|language=en|volume=37|issue=1|pages=25–43|doi=10.1016/S0042-6989(96)00111-3|pmid=9068829 |s2cid=16189579 }}</ref> | |||
For some types of "objects" that are not segmented as such by early visual processing, not even a single instance can be tracked. ] has shown that people are unable to track the ] of two lines sliding over each other, except possibly at very slow speeds.<ref>Anstis, S. (1990). Imperceptible intersections: The chopstick illusion. In A. Blake and T. Troscianko (Eds.), ''AI and the Eye''. London: Wiley and Sons Ltd., 105-117.</ref> | |||
Some things change shape as they move, such as liquids and ]s. For slinky-like objects that moved by extending their leading edges to a point and then retracting their trailing edges, Kristy vanMarle and Brian Scholl found that tracking performance was poor.<ref>{{Cite journal|last1=vanMarle|first1=Kristy|last2=Scholl|first2=Brian J.|date=September 2003|title=Attentive Tracking of Objects Versus Substances|url=http://journals.sagepub.com/doi/10.1111/1467-9280.03451|journal=Psychological Science|language=en|volume=14|issue=5|pages=498–504|doi=10.1111/1467-9280.03451|pmid=12930483 |s2cid=15083705 |issn=0956-7976}}</ref> The underlying reason for this is unclear, but reporting the location of even a lone object is impaired by growth or contraction of the object, which may contribute to the tracking failure.<ref name=":5" /> | |||
== Interference with concurrent performance of other tasks == | |||
Overlap among the processes underlying mental abilities can be revealed by what types of concurrent tasks interfere with each other. Attempting to track multiple visual objects typically interferes with other tasks,<ref name=":6">{{Cite journal|last1=Alvarez|first1=George A.|last2=Horowitz|first2=Todd S.|last3=Arsenio|first3=Helga C.|last4=DiMase|first4=Jennifer S.|last5=Wolfe|first5=Jeremy M.|date=2005|title=Do Multielement Visual Tracking and Visual Search Draw Continuously on the Same Visual Attention Resources?|url=http://doi.apa.org/getdoi.cfm?doi=10.1037/0096-1523.31.4.643|journal=Journal of Experimental Psychology: Human Perception and Performance|language=en|volume=31|issue=4|pages=643–667|doi=10.1037/0096-1523.31.4.643|pmid=16131240 |issn=1939-1277}}</ref> even for tasks with stimuli in other modalities.<ref name=":7">{{Cite journal|last1=Wahn|first1=Basil|last2=König|first2=Peter|date=2015-07-29|title=Audition and vision share spatial attentional resources, yet attentional load does not disrupt audiovisual integration|journal=Frontiers in Psychology|volume=6|page=1084 |doi=10.3389/fpsyg.2015.01084|issn=1664-1078|pmc=4518141|pmid=26284008 |doi-access=free }}</ref><ref name=":8">{{Cite journal|last1=Wahn|first1=Basil|last2=König|first2=Peter|date=2015|title=Vision and Haptics Share Spatial Attentional Resources and Visuotactile Integration Is Not Affected by High Attentional Load|url=https://brill.com/view/journals/msr/28/3-4/article-p371_10.xml|journal=Multisensory Research|volume=28|issue=3–4|pages=371–392|doi=10.1163/22134808-00002482|pmid=26288905 |issn=2213-4794}}</ref> Unfortunately, it can be difficult to determine whether this reflects processing somewhat specific to our ability to track or instead reflects the processing necessary to initiate and sustain a wide variety of tasks. | |||
One exception to the usual finding of interference with other tasks is that an auditory pitch discrimination task was found to not interfere with visual multiple object tracking.<ref>{{Cite journal|last1=Arrighi|first1=Roberto|last2=Lunardi|first2=Roy|last3=Burr|first3=David|date=2011|title=Vision and Audition Do Not Share Attentional Resources in Sustained Tasks|journal=Frontiers in Psychology|volume=2|page=56 |doi=10.3389/fpsyg.2011.00056|issn=1664-1078|pmc=3110771|pmid=21734893 |doi-access=free }}</ref> With a task designed as an auditory analog of tracking rather than just requiring discrimination of a few pitches, however, Daryl Fougnie et al. found that the task interfered approximately as much with visual object tracking as did a visual feature-tracking task. This suggests that auditory and visual tracking are limited by a common processing resource.<ref>{{Cite journal|last1=Fougnie|first1=Daryl|last2=Cockhren|first2=Jurnell|last3=Marois|first3=René|date=August 2018|title=A common source of attention for auditory and visual tracking|journal=Attention, Perception, & Psychophysics|language=en|volume=80|issue=6|pages=1571–1583|doi=10.3758/s13414-018-1524-9|issn=1943-3921|pmc=6061001|pmid=29717471}}</ref> | |||
== Neural basis == | |||
] studies find that activation of areas of the ] increases with the number of objects tracked, which is consistent with the suggestion that the parietal cortex plays a role in humans' limited tracking capacity.<ref>{{Cite journal|last1=Jovicich|first1=Jorge|last2=Peters|first2=Robert J.|last3=Koch|first3=Christof|last4=Braun|first4=Jochen|last5=Chang|first5=Linda|last6=Ernst|first6=Thomas|date=2001-11-15|title=Brain Areas Specific for Attentional Load in a Motion-Tracking Task|url=https://direct.mit.edu/jocn/article/13/8/1048/3594/Brain-Areas-Specific-for-Attentional-Load-in-a|journal=Journal of Cognitive Neuroscience|language=en|volume=13|issue=8|pages=1048–1058|doi=10.1162/089892901753294347|pmid=11784443 |s2cid=10836232 |issn=0898-929X}}</ref><ref>{{Cite journal|last1=Culham|first1=Jody C|last2=Cavanagh|first2=Patrick|last3=Kanwisher|first3=Nancy G|date=November 2001|title=Attention Response Functions|journal=Neuron|language=en|volume=32|issue=4|pages=737–745|doi=10.1016/S0896-6273(01)00499-8|pmid=11719212 |s2cid=14414579 |doi-access=free}}</ref><ref name=":3">{{Cite journal|last1=Alnaes|first1=D.|last2=Sneve|first2=M. H.|last3=Espeseth|first3=T.|last4=Endestad|first4=T.|last5=van de Pavert|first5=S. H. P.|last6=Laeng|first6=B.|date=2014-04-01|title=Pupil size signals mental effort deployed during multiple object tracking and predicts brain activity in the dorsal attention network and the locus coeruleus|journal=Journal of Vision|language=en|volume=14|issue=4|pages=1|doi=10.1167/14.4.1|pmid=24692319 |s2cid=11688513 |issn=1534-7362|doi-access=free}}</ref> Activation of other brain areas also seems to increase with target load, but the particular areas may be less consistent across studies than the parietal cortex finding. The size of participants' ] also increases with the number of objects tracked. The pupil size increase, which also is caused by mental effort in other tasks, may reflect norepinephrine release from the locus coeruleus.<ref name=":3" /><ref>{{Cite journal|last1=Wahn|first1=Basil|last2=Ferris|first2=Daniel P.|last3=Hairston|first3=W. David|last4=König|first4=Peter|date=2016-12-15|editor-last=Price|editor-first=Nicholas Seow Chiang|title=Pupil Sizes Scale with Attentional Load and Task Experience in a Multiple Object Tracking Task|journal=PLOS ONE|language=en|volume=11|issue=12|pages=e0168087|doi=10.1371/journal.pone.0168087|issn=1932-6203|pmc=5157994|pmid=27977762 |bibcode=2016PLoSO..1168087W |doi-access=free }}</ref> | |||
Objects presented to the left visual hemifield are processed initially by the right cerebral hemisphere, while stimuli presented to the right visual hemifield are processed initially by the left cerebral hemisphere. The independent capacity limits in the two hemifields are very similar, although there may be a small right-hemifield advantage.{{sfn|Holcombe|2023|loc=Section 9.6}} A right hemifield advantage would be consistent with a contribution by both parietal cortices to tracking that hemifield, which was suggested because both parietal cortices are thought to contribute to other attentional functions in the right hemifield.<ref>{{Cite journal|last=Mesulam|first=M.-Marsel|date=1999-07-29|editor-last=Howseman|editor-first=A.|editor2-last=Zeki|editor2-first=S.|title=Spatial attention and neglect: parietal, frontal and cingulate contributions to the mental representation and attentional targeting of salient extrapersonal events|journal=Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences|language=en|volume=354|issue=1387|pages=1325–1346|doi=10.1098/rstb.1999.0482|issn=0962-8436|pmc=1692628|pmid=10466154}}</ref> | |||
The neural basis of MOT has also been studied using ]. One such study found a robust correlation between tracking performance and the effect of number of targets on the ] event-related potential and also on contralateral delay activity.<ref>{{Cite journal|last1=Drew|first1=T.|last2=Vogel|first2=E. K.|date=2008-04-16|title=Neural Measures of Individual Differences in Selecting and Tracking Multiple Moving Objects|journal=Journal of Neuroscience|language=en|volume=28|issue=16|pages=4183–4191|doi=10.1523/JNEUROSCI.0556-08.2008|issn=0270-6474|pmc=2570324|pmid=18417697}}</ref> Multiple brain areas contribute to these signals, so such studies have not yet allowed researchers to determine exactly which brain areas mediate tracking. | |||
== Human variation and development == | |||
If a person is tested multiple times, their scores are usually similar to each other.<ref name=":10" /><ref>{{Cite journal|last1=Wilbiks|first1=Jonathan M. P.|last2=Beatteay|first2=Annika|date=October 2020|title=Individual differences in multiple object tracking, attentional cueing, and age account for variability in the capacity of audiovisual integration|journal=Attention, Perception, & Psychophysics|language=en|volume=82|issue=7|pages=3521–3543|doi=10.3758/s13414-020-02062-7|pmid=32529573 |s2cid=219606656 |issn=1943-3921|doi-access=free}}</ref><ref name="Treviño 51">{{Cite journal|last1=Treviño|first1=Melissa|last2=Zhu|first2=Xiaoshu|last3=Lu|first3=Yi Yi|last4=Scheuer|first4=Luke S.|last5=Passell|first5=Eliza|last6=Huang|first6=Grace C.|last7=Germine|first7=Laura T.|last8=Horowitz|first8=Todd S.|date=December 2021|title=How do we measure attention? Using factor analysis to establish construct validity of neuropsychological tests|journal=Cognitive Research: Principles and Implications|language=en|volume=6|issue=1|pages=51|doi=10.1186/s41235-021-00313-1|issn=2365-7464|pmc=8298746|pmid=34292418 |doi-access=free }}</ref><ref>{{Cite journal|last1=Eayrs|first1=Joshua|last2=Lavie|first2=Nilli|date=August 2018|title=Establishing individual differences in perceptual capacity.|url=http://doi.apa.org/getdoi.cfm?doi=10.1037/xhp0000530|journal=Journal of Experimental Psychology: Human Perception and Performance|language=en|volume=44|issue=8|pages=1240–1257|doi=10.1037/xhp0000530|pmid=29578735 |s2cid=4422544 |issn=1939-1277}}</ref> This suggests that the variation in the number of objects people seem able to track (for one version of the task, capacities ranged between one and six targets)<ref>{{Cite journal|last1=Meyerhoff|first1=Hauke S.|last2=Papenmeier|first2=Frank|date=December 2020|title=Individual differences in visual attention: A short, reliable, open-source, and multilingual test of multiple object tracking in PsychoPy|journal=Behavior Research Methods|language=en|volume=52|issue=6|pages=2556–2566|doi=10.3758/s13428-020-01413-4|pmid=32495028 |s2cid=256203146 |issn=1554-3528|doi-access=free}}</ref><ref name=":9">{{Cite journal|last1=Oksama|first1=Lauri|last2=Hyönä|first2=Jukka|date=July 2004|title=Is multiple object tracking carried out automatically by an early vision mechanism independent of higher-order cognition? An individual difference approach|url=http://www.tandfonline.com/doi/abs/10.1080/13506280344000473|journal=Visual Cognition|language=en|volume=11|issue=5|pages=631–671|doi=10.1080/13506280344000473|s2cid=144881546 |issn=1350-6285}}</ref> reflects real variation in ability. A caveat is that studies have failed to assess how much of this could be due to variation in individuals' motivation, but one study tested only top military recruits, a sample that was likely to be highly motivated, and also found substantial variation between individuals.<ref name=":9" /> | |||
Most research has been conducted on healthy undergraduates at universities in Western countries, so we don't know much about other populations. Comparing children of different ages, however, two studies in North America found a marked increase with age in the number of objects the children could track, from 6 or 7 years old to adulthood.<ref>{{Cite journal|last1=Trick|first1=Lana M.|last2=Jaspers-Fayer|first2=Fern|last3=Sethi|first3=Naina|date=2005-07-01|title=Multiple-object tracking in children: The "Catch the Spies" task|url=https://www.sciencedirect.com/science/article/pii/S0885201405000249|journal=Cognitive Development|language=en|volume=20|issue=3|pages=373–387|doi=10.1016/j.cogdev.2005.05.009|s2cid=655920 |issn=0885-2014}}</ref><ref name=":19">{{Cite journal|last1=Dye|first1=Matthew W. G.|last2=Bavelier|first2=Daphne|date=2010-02-22|title=Differential development of visual attention skills in school-age children|journal=Vision Research|series=Perceptual Learning Part II|language=en|volume=50|issue=4|pages=452–459|doi=10.1016/j.visres.2009.10.010|issn=0042-6989|pmc=2824025|pmid=19836409}}</ref> People with ] have been found to have poorer MOT performance than typically-developing people. This was attributed to a deficit in attentional selection in autism.<ref name=":20">{{Cite journal|last1=Koldewyn|first1=Kami|last2=Weigelt|first2=Sarah|last3=Kanwisher|first3=Nancy|last4=Jiang|first4=Yuhong|date=June 2013|title=Multiple Object Tracking in Autism Spectrum Disorders|journal=Journal of Autism and Developmental Disorders|language=en|volume=43|issue=6|pages=1394–1405|doi=10.1007/s10803-012-1694-6|issn=0162-3257|pmc=3581699|pmid=23104619}}</ref><ref name=":21">{{Cite journal|last1=O'Hearn|first1=Kirsten|last2=Franconeri|first2=Steven|last3=Wright|first3=Catherine|last4=Minshew|first4=Nancy|last5=Luna|first5=Beatriz|date=April 2013|title=The development of individuation in autism.|journal=Journal of Experimental Psychology: Human Perception and Performance|language=en|volume=39|issue=2|pages=494–509|doi=10.1037/a0029400|issn=1939-1277|pmc=3608798|pmid=22963232}}</ref> | |||
Adults with ] have profound deficits on certain spatial assembly tasks, such as copying a four-block ] pattern.<ref>{{Cite journal|last1=Mervis|first1=Carolyn B.|last2=Robinson|first2=Byron F.|last3=Pani|first3=John R.|date=November 1999|title=Visuospatial Construction|journal=The American Journal of Human Genetics|language=en|volume=65|issue=5|pages=1222–1229|doi=10.1086/302633|pmc=1288273|pmid=10521286}}</ref> For multiple object tracking, their performance is similar to typically-developing four- or five-year-old children.<ref>{{Cite journal|last1=Ferrara|first1=Katrina|last2=Hoffman|first2=James E.|last3=O’Hearn|first3=Kirsten|last4=Landau|first4=Barbara|date=2016-08-07|title=Constraints on Multiple Object Tracking in Williams Syndrome: How Atypical Development Can Inform Theories of Visual Processing|journal=Journal of Cognition and Development|language=en|volume=17|issue=4|pages=620–641|doi=10.1080/15248372.2016.1195389|s2cid=4677194 |issn=1524-8372|doi-access=free}}</ref><ref name=":20" /><ref name=":21" /> In contrast, their ability to remember the locations of MOT targets if they don't move is more comparable to typically-developing 6-year-olds, which has led to the suggestion that maintaining attentional selection is a particular problem in Williams Syndrome.<ref>{{Cite journal|last1=O’Hearn|first1=Kirsten|last2=Hoffman|first2=James E.|last3=Landau|first3=Barbara|date=May 2010|title=Developmental profiles for multiple object tracking and spatial memory: typically developing preschoolers and people with Williams syndrome: Multiple object tracking in preschool children and WS|journal=Developmental Science|language=en|volume=13|issue=3|pages=430–440|doi=10.1111/j.1467-7687.2009.00893.x|pmc=2927133|pmid=20443964}}</ref> | |||
Among older typically-developing adults, MOT performance falls steeply with age.<ref name=":14" /><ref>{{Cite journal|last1=Sekuler|first1=Robert|last2=McLaughlin|first2=Chris|last3=Yotsumoto|first3=Yuko|date=June 2008|title=Age-Related Changes in Attentional Tracking of Multiple Moving Objects|url=http://journals.sagepub.com/doi/10.1068/p5923|journal=Perception|language=en|volume=37|issue=6|pages=867–876|doi=10.1068/p5923|pmid=18686706 |s2cid=879560 |issn=0301-0066}}</ref><ref>{{Cite journal|last1=Kennedy|first1=G. J.|last2=Tripathy|first2=S. P.|last3=Barrett|first3=B. T.|date=2009-02-01|title=Early age-related decline in the effective number of trajectories tracked in adult human vision|journal=Journal of Vision|language=en|volume=9|issue=2|pages=21.1–10|doi=10.1167/9.2.21|pmid=19271931 |issn=1534-7362|doi-access=free}}</ref> Age-related increases in spatial crowding<ref>{{Cite journal|last1=Scialfa|first1=C. T.|last2=Cordazzo|first2=S.|last3=Bubric|first3=K.|last4=Lyon|first4=J.|date=2013-07-01|title=Aging and Visual Crowding|url=https://academic.oup.com/psychsocgerontology/article-lookup/doi/10.1093/geronb/gbs086|journal=The Journals of Gerontology Series B: Psychological Sciences and Social Sciences|language=en|volume=68|issue=4|pages=522–528|doi=10.1093/geronb/gbs086|pmid=23009956 |issn=1079-5014|doi-access=free}}</ref> and temporal crowding<ref name=":14" /> likely contribute to this. | |||
Several papers report that video game players perform substantially better in MOT tasks than those who do not play video games.<ref name=":19" /><ref>{{Cite journal|last1=Green|first1=C. S.|last2=Bavelier|first2=D.|date=2006-08-01|title=Enumeration versus multiple object tracking: the case of action video game players|journal=Cognition|language=en|volume=101|issue=1|pages=217–245|doi=10.1016/j.cognition.2005.10.004|issn=0010-0277|pmc=2896820|pmid=16359652}}</ref> However, it has been suggested that this could be an artifact of research practices such as selective publication of results.<ref>{{Cite journal|last1=Hilgard|first1=Joseph|last2=Sala|first2=Giovanni|last3=Boot|first3=Walter R.|last4=Simons|first4=Daniel J.|date=2019-01-01|title=Overestimation of Action-Game Training Effects: Publication Bias and Salami Slicing|journal=Collabra: Psychology|volume=5|issue=1|doi=10.1525/collabra.231|s2cid=198617728 |issn=2474-7394|doi-access=free}}</ref> | |||
=== Covariation of object tracking ability with other abilities === | |||
While some have used MOT in an attempt to ensure study participants sustain their attention over a long interval, a study with a large number of participants found little correlation with a ] specifically designed to measure lapses in attention.<ref name=":15">{{Cite journal|last1=Fortenbaugh|first1=Francesca C.|last2=DeGutis|first2=Joseph|last3=Germine|first3=Laura|last4=Wilmer|first4=Jeremy B.|last5=Grosso|first5=Mallory|last6=Russo|first6=Kathryn|last7=Esterman|first7=Michael|date=September 2015|title=Sustained Attention Across the Life Span in a Sample of 10,000: Dissociating Ability and Strategy|journal=Psychological Science|language=en|volume=26|issue=9|pages=1497–1510|doi=10.1177/0956797615594896|issn=0956-7976|pmc=4567490|pmid=26253551}}</ref> MOT may, then, be forgiving of lapses in attention, which is consistent with findings that for typical displays, participants can perform well in MOT even if they are occasionally briefly interrupted, with their tracking processes able to pick up where they left off.<ref name=":6" /><ref>{{Cite journal|last1=Horowitz|first1=Todd S.|last2=Birnkrant|first2=Randall S.|last3=Fencsik|first3=David E.|last4=Tran|first4=Linda|last5=Wolfe|first5=Jeremy M.|date=June 2006|title=How do we track invisible objects?|journal=Psychonomic Bulletin & Review|language=en|volume=13|issue=3|pages=516–523|doi=10.3758/BF03193879|pmid=17048740 |s2cid=9749474 |issn=1069-9384|doi-access=free}}</ref> | |||
One approach to investigating which tasks share underlying processing is to test participants on several different tasks to determine which tasks have the highest correlations across individuals. The results of studies that have done this with MOT have not been entirely consistent with each other, so which tasks yield the highest correlation with MOT performance is not yet clear. However, multiple studies find that visual working memory is one of the most highly-correlated tasks.<ref name=":10">{{Cite journal|last1=Huang|first1=Liqiang|last2=Mo|first2=Lei|last3=Li|first3=Ying|date=April 2012|title=Measuring the interrelations among multiple paradigms of visual attention: An individual differences approach.|url=http://doi.apa.org/getdoi.cfm?doi=10.1037/a0026314|journal=Journal of Experimental Psychology: Human Perception and Performance|language=en|volume=38|issue=2|pages=414–428|doi=10.1037/a0026314|pmid=22250865 |issn=1939-1277}}</ref><ref name="Treviño 51"/> That correlation is consistent with findings that working memory tasks are among the best predictors of performance in a range of tasks.<ref>{{Cite journal|last1=Redick|first1=Thomas S.|last2=Engle|first2=Randall W.|date=July 2006|title=Working memory capacity and attention network test performance|url=https://onlinelibrary.wiley.com/doi/10.1002/acp.1224|journal=Applied Cognitive Psychology|language=en|volume=20|issue=5|pages=713–721|doi=10.1002/acp.1224|issn=0888-4080}}</ref> This may reflect shared mechanisms such as maintaining goal-relevant information in memory (possibly including which objects are the targets) and disengaging from outdated or irrelevant information.<ref>{{Cite book|url=https://academic.oup.com/book/31963/chapter/267698194|title=Individual Differences in Attention Control: Implications for the Relationship Between Working Memory Capacity and Fluid Intelligence|last1=Mashburn|first1=Cody A.|last2=Tsukahara|first2=Jason S.|last3=Engle|first3=Randall W.|date=2020-11-05|publisher=Oxford University Press|isbn=978-0-19-884228-6|pages=175–211|language=en|doi=10.1093/oso/9780198842286.003.0007}}</ref> | |||
=== Use in ability testing and training === | |||
Some professional sports teams use laboratory-style MOT tests for ability assessment and for training.<ref name=":11">{{Cite news|url=https://www.nytimes.com/2017/01/04/sports/neurotracker-athletic-performance.html|title=Keep Your Eye on the Balls to Become a Better Athlete|last=Schonbrun|first=Zach|date=2017-01-04|work=The New York Times|access-date=2022-10-06|language=en-US|issn=0362-4331}}</ref> Associates of the company that makes the "]" MOT product claim that NeuroTracker is a "cognitive enhancer" that improves a variety of abilities relevant to performance on the sports field, but the evidence in the studies purporting to show this is weak.<ref>{{Cite journal|last1=Vater|first1=Christian|last2=Gray|first2=Rob|last3=Holcombe|first3=Alex O.|date=October 2021|title=A critical systematic review of the Neurotracker perceptual-cognitive training tool|journal=Psychonomic Bulletin & Review|language=en|volume=28|issue=5|pages=1458–1483|doi=10.3758/s13423-021-01892-2|issn=1069-9384|pmc=8500884|pmid=33821464}}</ref> Another reason for skepticism of such claims is the poor track record of other commercial "brain training" products advertised for their cognitive-enhancing effects.<ref name=":11" /><ref>{{Cite journal|last1=Simons|first1=Daniel J.|last2=Boot|first2=Walter R.|last3=Charness|first3=Neil|last4=Gathercole|first4=Susan E.|last5=Chabris|first5=Christopher F.|last6=Hambrick|first6=David Z.|last7=Stine-Morrow|first7=Elizabeth A. L.|date=October 2016|title=Do "Brain-Training" Programs Work?|url=http://journals.sagepub.com/doi/10.1177/1529100616661983|journal=Psychological Science in the Public Interest|language=en|volume=17|issue=3|pages=103–186|doi=10.1177/1529100616661983|pmid=27697851 |s2cid=13729927 |issn=1529-1006}}</ref> | |||
While it is unlikely that training on laboratory-style MOT tasks yields broad mental benefits, when more rigorous studies are done, it is possible that firm evidence may support the use of tasks related to MOT for screening or training purposes for specific purposes. Regarding screening, however, one study found that laboratory MOT performance did not predict driving test performance as well as the ], a trail-making task, or a useful field-of-view task.<ref>{{Cite journal|last1=Bowers|first1=Alex R.|last2=Anastasio|first2=R. Julius|last3=Sheldon|first3=Sarah S.|last4=O’Connor|first4=Margaret G.|last5=Hollis|first5=Ann M.|last6=Howe|first6=Piers D.|last7=Horowitz|first7=Todd S.|date=October 2013|title=Can we improve clinical prediction of at-risk older drivers?|journal=Accident Analysis & Prevention|language=en|volume=59|pages=537–547|doi=10.1016/j.aap.2013.06.037|pmc=3769510|pmid=23954688}}</ref> A multiple object avoidance (MOA) task, involving steering a ball with a computer mouse to prevent it from colliding with other moving balls on a computer screen, was found to correlate better with driving performance than MOT.<ref>{{Cite journal|last1=Mackenzie|first1=Andrew K.|last2=Harris|first2=Julie M.|date=February 2017|title=A link between attentional function, effective eye movements, and driving ability.|journal=Journal of Experimental Psychology: Human Perception and Performance|language=en|volume=43|issue=2|pages=381–394|doi=10.1037/xhp0000297|issn=1939-1277|pmc=5279462|pmid=27893270}}</ref> In another study, strong positive correlations with MOA performance were found with driving simulator performance and years of driving experience.<ref>{{Cite journal|last1=Mackenzie|first1=Andrew K.|last2=Vernon|first2=Mike L.|last3=Cox|first3=Paul R.|last4=Crundall|first4=David|last5=Daly|first5=Rosie C.|last6=Guest|first6=Duncan|last7=Muhl-Richardson|first7=Alexander|last8=Howard|first8=Christina J.|date=June 2022|title=The Multiple Object Avoidance (MOA) task measures attention for action: Evidence from driving and sport|journal=Behavior Research Methods|language=en|volume=54|issue=3|pages=1508–1529|doi=10.3758/s13428-021-01679-2|pmid=34786653 |pmc=9170642 |issn=1554-3528}}</ref> This may be because MOA includes control of movement, which is necessary for driving, but is not required for MOT.{{sfn|Holcombe|2023|loc=Section 12}} | |||
== Theories and models == | |||
Published ]s fit some aspects of tracking results, with most focusing on the pattern of performance decline with increasing number of targets, and some modeling the dissociation between position and non-position features. No published theory purports to explain all four of the following: the difficulty with tracking parts of objects, the role of temporal interference, the dissociation between position and non-positional features, and the pattern of performance decline with increasing number of targets. | |||
=== Serial versus parallel processing === | |||
The independence of tracking in the left and right hemifields suggests that position updating in each hemifield occurs independently of and in parallel with position updating in the other hemifield (''see ]''). Within a hemifield, it is not yet completely clear whether tracking of multiple objects happens in parallel or instead the target positions are updated one-by-one, but most recent theorists agree with Pylyshyn's original FINST theory that positions are updated in parallel.<ref name=":0" /><ref name=":23" /><ref name=":24" /><ref name=":25" /> A finding that gives some support to the alternative of serial switching is the marked increase in temporal interference as the number of targets tracked increases. In particular, the amount of increase in time needed between when a target leaves a location and a distractor takes its place is approximately predicted by the theory that attention must visit each moving target one-by-one to update its location.<ref name=":13" /> | |||
Some who theorize that position updating occurs simultaneously for multiple targets draw a contrast with features other than position, stating that they are updated by a process that must serially switch among the targets.<ref name=":0">{{Cite journal|last1=Oksama|first1=Lauri|last2=Hyönä|first2=Jukka|date=January 2016|title=Position tracking and identity tracking are separate systems: Evidence from eye movements|journal=Cognition|language=en|volume=146|pages=393–409|doi=10.1016/j.cognition.2015.10.016|pmid=26529194 |s2cid=14749878 |doi-access=free}}</ref><ref name=":23">{{Cite journal|last1=Li|first1=Jie|last2=Oksama|first2=Lauri|last3=Hyönä|first3=Jukka|date=January 2019|title=Model of Multiple Identity Tracking (MOMIT) 2.0: Resolving the serial vs. parallel controversy in tracking|journal=Cognition|language=en|volume=182|pages=260–274|doi=10.1016/j.cognition.2018.10.016|pmid=30384128 |s2cid=53181791 |doi-access=free}}</ref><ref name=":24">{{Cite journal|last1=Lovett|first1=Andrew|last2=Bridewell|first2=Will|last3=Bello|first3=Paul|date=2019-12-23|title=Selection enables enhancement: An integrated model of object tracking|url=https://jov.arvojournals.org/article.aspx?articleid=2757905|journal=Journal of Vision|language=en|volume=19|issue=14|pages=23|doi=10.1167/19.14.23|pmid=31868894 |s2cid=209446017 |issn=1534-7362|doi-access=free}}</ref><ref name=":25">{{Cite journal|last1=Kazanovich|first1=Yakov|last2=Borisyuk|first2=Roman|date=June 2006|title=An Oscillatory Neural Model of Multiple Object Tracking|url=https://direct.mit.edu/neco/article/18/6/1413-1440/7124|journal=Neural Computation|language=en|volume=18|issue=6|pages=1413–1440|doi=10.1162/neco.2006.18.6.1413|pmid=16764509 |s2cid=13947567 |issn=0899-7667}}</ref> A model by Lovett, Bridewell, & Bello published in 2019, for example, includes a parallel process to track changes in position and connect to visual pointers that are shared with visual short-term memory and other visual attention tasks. A serial selection process is also included, which operates on only one object at a time and enables access to a target's motion history and other features.<ref name=":24"/> | |||
=== Slots versus resources === | |||
Central to Pylyshyn's FINST theory is that a small set of discrete pointers mediate multiple object tracking. Subsequent researchers have suggested that rather than discrete pointers, a mental resource that is more continuous is divided among the targets.<ref>{{Cite journal|last1=Alvarez|first1=George A.|last2=Franconeri|first2=Steven L.|date=2007-10-30|title=How many objects can you track?: Evidence for a resource-limited attentive tracking mechanism|journal=Journal of Vision|volume=7|issue=13|pages=14.1–10|doi=10.1167/7.13.14|pmid=17997642 |issn=1534-7362|doi-access=free}}</ref><ref>{{cite book|last1=Vul|first1= E.|last2= Frank|first2= M.|last3= Tenenbaum|first3= J.|last4= Alvarez|first4= G. A.|date=2009|chapter=Explaining human multiple object tracking as resource-constrained approximate inference in a dynamic probabilistic model|title=Advances in Neural Information Processing Systems|volume= 22|url=http://books.nips.cc/papers/files/nips22/NIPS2009_0980.pdf|isbn=9781615679119|pages=1955–1963|publisher= Neural Information Processing Systems|editor1-first=Y.|editor1-last= Bengio |editor2-first= D.|editor2-last= Schuurmans|editor3-first= J.|editor3-last= Lafferty |editor4-first=C.|editor4-last= Williams|editor5-first= A. |editor5-last=Culotta}}</ref> This dispute is similar to the "slots versus resources" debate in the study of ]. A continuous resource naturally explains the smooth decline in performance with number of targets, although there is no agreement about what precisely about tracking becomes worse when less resource is provided. Possibilities include ], ], the maximum speed of the tracker, or all three (''see ]''). | |||
== References == | |||
{{Academic peer reviewed|Q=Q115162234|doi-access=free}} | |||
{{reflist}} | |||
==External links== | ==External links== |
Latest revision as of 08:37, 24 May 2024
Mental ability to track moving objects with attention For object tracking by computers, see Video tracking.In psychology and neuroscience, multiple object tracking (MOT) refers to the ability of humans and other animals to simultaneously monitor multiple objects as they move. It is also the term for certain laboratory techniques used to study this ability.
In an MOT study, several identical moving objects are presented on a display. Some of the objects are designated as targets while the rest serve as 'distractors'. The study participants try to monitor the changing positions of the targets as they and the distractions move about. At the end of the trial, typically the participants are asked to indicate the final positions of the targets.
The results of MOT experiments have revealed limitations on humans' ability to simultaneously monitor multiple moving objects. For example, awareness of features such as color and shape is disrupted by the objects' movement.
Background
History
In the 1970s, researcher Zenon Pylyshyn postulated the existence of a "primitive visual process" in the human brain capable of "indexing and tracking features or feature-clusters". Using this process, cognitive processes can continuously refer to, or "track", objects despite movement of the objects causing them to stimulate different visual neurons over time. Data collected with Pylyshyn's MOT protocol and published in 1988 provided the first formal demonstration that the mind can keep track of the changing positions of multiple moving objects.
As a specific theory of this ability, Pylyshyn proposed "fingers of instantiation" theory (FINST), which claims that tracking is mediated by a fixed set of discrete pointers. While FINST theory has been very influential, many studies have found evidence that seems inconsistent with the theory.
Procedure
A typical MOT study involves the presentation of between eight and twelve objects. The participant is told to monitor the positions of a subset of the objects, which are referred to as targets. Often the targets are indicated by being presented initially in a distinct color. The targets then become identical in appearance to the other, distractor objects. The targets and distractors move about the screen for several seconds in an unpredictable fashion. The participant is then asked to indicate which of the objects are the targets. The accuracy of the participant's judgments indicates whether the participant mentally updated the positions of the targets as they moved.
To ensure that the task requires participants to mentally update the targets' positions, displays are typically designed such that object paths cause the targets to swap positions with distractors, at least occasionally. With that constraint, MOT task variations have been designed to probe specific aspects of how the mind tracks moving objects. For example, to compare performance in the left to performance in the right visual fields, studies confine some or all the moving objects to one of the visual fields. To avoid any contribution from spatial interference among mental object representations, some studies maintain a minimum distance between objects. Other studies have combined MOT with a concurrent task to investigate whether the two tasks draw on the same mental resource, and have changed target features such as color to assess whether study participants update their representations of those features.
Capacity limits
MOT study results indicate that the number of targets that people can track is very limited. This reflects a bottleneck in the brain's processing architecture. While at the early, sensory stages of visual processing, dozens of objects may be fully processed, later processes such as those associated with cognition have much more limited capacity to process visual objects.
The specific number of visual objects that people can accurately track varies widely with display parameters, contrary to a common belief that people can track no more than four or five objects. Even for a fixed set of display parameters, rather than there being a clear limit, performance falls gradually with the number of targets. Such findings undermine Pylyshyn's FINST theory that tracking is mediated by a fixed set of discrete pointers.
The above limitations appear to stem from processes specific to the two cerebral hemispheres. The independence of the limits in the two hemifields is demonstrated by findings that when one is tracking the maximum number that can be tracked in the left hemifield (which is processed by the right cerebral hemisphere), one can add targets to the right hemifield (which is processed by the left cerebral hemisphere) at little to no cost to performance. For features other than position, capacity seems to be more limited—see § Updating of features other than position.
While the tracking capacity limit is largely set separately by the two cerebral hemispheres, a more unified and cognitive resource also can contribute to tracking. For example, if there is only one target, one can bring one's full cognitive abilities to bear, such as in predicting future positions, to facilitate tracking. When more targets are present, these resources may still play a role.
Spatiotemporal limits
If the objects of a display are not sufficiently widely spaced, the objects are difficult to identify and select with attention due to spatial crowding, which can prevent tracking. High object speeds have a similar effect—faster objects are harder to track, and humans are completely unable to track objects that move sufficiently fast. This "speed limit", however, is much slower than the maximum object speed at which humans can judge the object's movement direction. This dissociation between motion perception and object tracking is thought to reflect that direction judgments can be based on low-level and local motion detector responses that do not register the positions of objects.
As an object's speed is increased, temporal crowding can result and prevent tracking well before the tracking speed limit is reached. Temporal crowding refers to an impairment caused by distractors visiting a target's former location within a short interval. The phenomenon was revealed in a study with a display where distractors were evenly-spaced along a circular trajectory that was also shared by a target. Participants could not track three targets if the locations traversed were visited by objects more than three times per second, and this was true even if the objects were moving at a relatively slow speed. This temporal crowding limit on tracking becomes more severe as the number of targets increases.
As the spatial, temporal, and speed limits are approached, tracking performance decreases gradually and in typical MOT displays, it is unclear which of these limits, or what combination of them, determine the maximum number of targets that can be tracked. For the spatial limit, one study found little to no effect beyond the Bouma's law crowding zone. Many MOT studies do not enforce sufficient spacing between objects to avoid spatial crowding, making spatial crowding likely to be one factor in overall performance.
Role of prediction and trajectory information
Brains continuously predict some aspects of the future. In the case of multiple object tracking, however, several MOT studies have found evidence against extrapolation of future positions.
When future positions are predictable, human object tracking performance can be higher than when future positions are unpredictable. However, the benefit seems to disappear when there are more than one or two targets, suggesting that any prediction happening is more limited in processing capacity than other aspects of object tracking. One issue with those studies, however, it that predictability of objects' future positions appears to be confounded with the objects being distinguishable from each other (on the basis of maintaining particular and different motion directions). In such experiments, the difference in targets' and distractors' motion directions or accelerations may be the facilitator of tracking rather than prediction of future positions. Indeed, distinctiveness of motion directions alone facilitates tracking. Ability to detect a change in a target's trajectory is much worse with each increase in target number. This suggests motion direction is only utilized when there are few targets, and may explain why the predictability benefit is confined to when there are only a few targets.
Role of grouping and coordinate frames
The human brain represents the positions of objects with multiple reference frames or coordinate systems. Early stages of the visual system represent the locations of objects relative to the direction the eyes are pointing (retinotopic coordinates). Some later stages of human visual processing can represent object locations relative to each other or to the scene.
Regarding representation of relative locations, the relative positions of objects can be represented with an imaginary polygon, with each target a different vertex of that polygon. In studies of MOT, Steve Yantis drew participants' attention to the polygon formed by the targets and found that benefited performance, as did setting the targets' trajectories to avoid much disruption of the constantly-morphing polygon. This suggests that shape tracking contributes to accurate performance, at least in some participants. One study measured an electrical brain response (ERP) to a probe that was flashed while the objects were moving. The earliest-detectable part of the neural response to the probe was significantly greater if the probe lay on the polygon defined by the targets rather than inside or outside the polygon. This suggests that at least some of the participants continuously tracked the polygon defined by the targets.
Displays with more complicated statistical relationships among moving targets have been devised to show that regularities in hierarchical relationships are extracted and utilized in multiple object tracking, including nesting of groups of objects within moving reference frames.
Updating of features other than position
The classic MOT task requires updating of targets' positions but not their other features. People appear to be less able to update the other features of targets, and have difficulty even in maintaining their knowledge of such features as the associated objects move. In one study, Pylyshyn assigned distinct identities to four identical targets, either by giving them names or by giving them easily-identifiable starting positions: the four corners of the screen. In addition to the usual task at the end of the trial of identifying which objects were the targets, participants also were asked about the identity of the targets – which one each was. Contrary to what Pylyshyn expected from his FINST theory, accuracy at identifying which target was which was very low, even when accuracy reporting the targets' positions was high.
To assess maintenance of knowledge of object identities, one series of experiments used cartoon animals as targets and distractors that all moved about the screen. By the end of each trial, the animals came to rest behind cartoons of cacti, so that their identities were no longer visible. Participants were asked where a particular target (e.g., the cartoon rabbit) had gone—that is, which occluder it was hiding behind. In this multiple identity tracking (MIT) task, performance was much worse than in the standard MOT task of reporting target locations irrespective of which target a location belonged to.
The deficit in updating the locations of featural and identity information may reflect a more general deficit in updating the locations of objects in visual short-term memory. In a study using a shell game in which the shells hid brightly-colored balls of wool, pairs of shells were swapped at a slow rate of once a second, but accuracy judging which shell contained a particular color fell to 80% accuracy when there were four swaps in a simple three-shell display, compared to 95% accuracy for four swaps with a two-shell display.
The concept of an "object file" is that of a record in the brain that stores the features of a visual object, with the location record updated as the object moves. In the original studies that were motivated by this idea, one feature an object disappears and the object moves to a new location. The feature is then presented in the new location, and people respond faster to that feature than to features that were not previously presented as part of the object. This finding of priming indicates that an object file was created and updated by the brain. One might expect this to tap into the same processing as that assessed by the MIT task. The relationship between the two is unclear, however, as there is evidence that attentional tracking occurs can occur along a different trajectory than that which is the basis of updating the memory of an object's features.
In the studies mentioned so far, the objects involved did not change any of their features besides their positions, so the task was to maintain knowledge of (unchanging) features while updating their positions. Change blindness studies show that in many circumstances, people do poorly at noticing that features have changed. A famous demonstration involves placing a blank screen between the presentation of two versions of a screen to mask the flicker that would otherwise be associated with a change. Change blindness also occurs when the flicker evoked by the change is masked by the objects' motion. That, however, may only mean that nothing is comparing the features present before and after the change; it does not necessarily mean that object representations are not updated, so other studies are needed.
A related issue is whether tracking can occur on the basis not only of smooth changes in the position of an object, but also on the basis of smooth changes in an object's other features. In a tracking experiment in which two objects were always spatially superposed, the objects maintained their separate identities based on smooth continuity of their colors, orientations, and spatial frequencies. The participants could only track one such object, suggesting no ability to capitalize on spatiotemporal feature continuity for features other than position, although this has not yet been tested for cases in which the targets do not overlap (overlap may trigger figure-ground interference).
Difficulty tracking unusual objects and object parts
Many objects have clearly-visible parts. A dumbbell, for example, has a central bar part and has the weights at the bar's ends. Even when such parts are conspicuous, people can have difficulty tracking an individual part of multiple objects. When individual ends of multiple dumbbell-shaped drawings are designated as targets, tracking performance is poor. Performance was even worse when participants attempted to track one end of multiple moving lines, where the lines were uniform without distinct parts. Evidently, the mental processes that underlie tracking of multiple objects operate on a particular type of object representation that differs from what we can consciously recognize. Possibly the representation used for tracking is shared by that used when searching for a particular colored shape that is hidden among many other shapes; visual search is hindered by connecting targets to distractors.
For some types of "objects" that are not segmented as such by early visual processing, not even a single instance can be tracked. Stuart Anstis has shown that people are unable to track the intersection of two lines sliding over each other, except possibly at very slow speeds.
Some things change shape as they move, such as liquids and slinkys. For slinky-like objects that moved by extending their leading edges to a point and then retracting their trailing edges, Kristy vanMarle and Brian Scholl found that tracking performance was poor. The underlying reason for this is unclear, but reporting the location of even a lone object is impaired by growth or contraction of the object, which may contribute to the tracking failure.
Interference with concurrent performance of other tasks
Overlap among the processes underlying mental abilities can be revealed by what types of concurrent tasks interfere with each other. Attempting to track multiple visual objects typically interferes with other tasks, even for tasks with stimuli in other modalities. Unfortunately, it can be difficult to determine whether this reflects processing somewhat specific to our ability to track or instead reflects the processing necessary to initiate and sustain a wide variety of tasks.
One exception to the usual finding of interference with other tasks is that an auditory pitch discrimination task was found to not interfere with visual multiple object tracking. With a task designed as an auditory analog of tracking rather than just requiring discrimination of a few pitches, however, Daryl Fougnie et al. found that the task interfered approximately as much with visual object tracking as did a visual feature-tracking task. This suggests that auditory and visual tracking are limited by a common processing resource.
Neural basis
Neuroimaging studies find that activation of areas of the parietal cortex increases with the number of objects tracked, which is consistent with the suggestion that the parietal cortex plays a role in humans' limited tracking capacity. Activation of other brain areas also seems to increase with target load, but the particular areas may be less consistent across studies than the parietal cortex finding. The size of participants' pupils also increases with the number of objects tracked. The pupil size increase, which also is caused by mental effort in other tasks, may reflect norepinephrine release from the locus coeruleus.
Objects presented to the left visual hemifield are processed initially by the right cerebral hemisphere, while stimuli presented to the right visual hemifield are processed initially by the left cerebral hemisphere. The independent capacity limits in the two hemifields are very similar, although there may be a small right-hemifield advantage. A right hemifield advantage would be consistent with a contribution by both parietal cortices to tracking that hemifield, which was suggested because both parietal cortices are thought to contribute to other attentional functions in the right hemifield.
The neural basis of MOT has also been studied using electroencephalography (EEG). One such study found a robust correlation between tracking performance and the effect of number of targets on the N2pc event-related potential and also on contralateral delay activity. Multiple brain areas contribute to these signals, so such studies have not yet allowed researchers to determine exactly which brain areas mediate tracking.
Human variation and development
If a person is tested multiple times, their scores are usually similar to each other. This suggests that the variation in the number of objects people seem able to track (for one version of the task, capacities ranged between one and six targets) reflects real variation in ability. A caveat is that studies have failed to assess how much of this could be due to variation in individuals' motivation, but one study tested only top military recruits, a sample that was likely to be highly motivated, and also found substantial variation between individuals.
Most research has been conducted on healthy undergraduates at universities in Western countries, so we don't know much about other populations. Comparing children of different ages, however, two studies in North America found a marked increase with age in the number of objects the children could track, from 6 or 7 years old to adulthood. People with autism spectrum disorders have been found to have poorer MOT performance than typically-developing people. This was attributed to a deficit in attentional selection in autism.
Adults with Williams Syndrome have profound deficits on certain spatial assembly tasks, such as copying a four-block checkerboard pattern. For multiple object tracking, their performance is similar to typically-developing four- or five-year-old children. In contrast, their ability to remember the locations of MOT targets if they don't move is more comparable to typically-developing 6-year-olds, which has led to the suggestion that maintaining attentional selection is a particular problem in Williams Syndrome.
Among older typically-developing adults, MOT performance falls steeply with age. Age-related increases in spatial crowding and temporal crowding likely contribute to this.
Several papers report that video game players perform substantially better in MOT tasks than those who do not play video games. However, it has been suggested that this could be an artifact of research practices such as selective publication of results.
Covariation of object tracking ability with other abilities
While some have used MOT in an attempt to ensure study participants sustain their attention over a long interval, a study with a large number of participants found little correlation with a continuous performance task specifically designed to measure lapses in attention. MOT may, then, be forgiving of lapses in attention, which is consistent with findings that for typical displays, participants can perform well in MOT even if they are occasionally briefly interrupted, with their tracking processes able to pick up where they left off.
One approach to investigating which tasks share underlying processing is to test participants on several different tasks to determine which tasks have the highest correlations across individuals. The results of studies that have done this with MOT have not been entirely consistent with each other, so which tasks yield the highest correlation with MOT performance is not yet clear. However, multiple studies find that visual working memory is one of the most highly-correlated tasks. That correlation is consistent with findings that working memory tasks are among the best predictors of performance in a range of tasks. This may reflect shared mechanisms such as maintaining goal-relevant information in memory (possibly including which objects are the targets) and disengaging from outdated or irrelevant information.
Use in ability testing and training
Some professional sports teams use laboratory-style MOT tests for ability assessment and for training. Associates of the company that makes the "NeuroTracker" MOT product claim that NeuroTracker is a "cognitive enhancer" that improves a variety of abilities relevant to performance on the sports field, but the evidence in the studies purporting to show this is weak. Another reason for skepticism of such claims is the poor track record of other commercial "brain training" products advertised for their cognitive-enhancing effects.
While it is unlikely that training on laboratory-style MOT tasks yields broad mental benefits, when more rigorous studies are done, it is possible that firm evidence may support the use of tasks related to MOT for screening or training purposes for specific purposes. Regarding screening, however, one study found that laboratory MOT performance did not predict driving test performance as well as the Montreal Cognitive Assessment, a trail-making task, or a useful field-of-view task. A multiple object avoidance (MOA) task, involving steering a ball with a computer mouse to prevent it from colliding with other moving balls on a computer screen, was found to correlate better with driving performance than MOT. In another study, strong positive correlations with MOA performance were found with driving simulator performance and years of driving experience. This may be because MOA includes control of movement, which is necessary for driving, but is not required for MOT.
Theories and models
Published computational models fit some aspects of tracking results, with most focusing on the pattern of performance decline with increasing number of targets, and some modeling the dissociation between position and non-position features. No published theory purports to explain all four of the following: the difficulty with tracking parts of objects, the role of temporal interference, the dissociation between position and non-positional features, and the pattern of performance decline with increasing number of targets.
Serial versus parallel processing
The independence of tracking in the left and right hemifields suggests that position updating in each hemifield occurs independently of and in parallel with position updating in the other hemifield (see § Capacity limits). Within a hemifield, it is not yet completely clear whether tracking of multiple objects happens in parallel or instead the target positions are updated one-by-one, but most recent theorists agree with Pylyshyn's original FINST theory that positions are updated in parallel. A finding that gives some support to the alternative of serial switching is the marked increase in temporal interference as the number of targets tracked increases. In particular, the amount of increase in time needed between when a target leaves a location and a distractor takes its place is approximately predicted by the theory that attention must visit each moving target one-by-one to update its location.
Some who theorize that position updating occurs simultaneously for multiple targets draw a contrast with features other than position, stating that they are updated by a process that must serially switch among the targets. A model by Lovett, Bridewell, & Bello published in 2019, for example, includes a parallel process to track changes in position and connect to visual pointers that are shared with visual short-term memory and other visual attention tasks. A serial selection process is also included, which operates on only one object at a time and enables access to a target's motion history and other features.
Slots versus resources
Central to Pylyshyn's FINST theory is that a small set of discrete pointers mediate multiple object tracking. Subsequent researchers have suggested that rather than discrete pointers, a mental resource that is more continuous is divided among the targets. This dispute is similar to the "slots versus resources" debate in the study of working memory. A continuous resource naturally explains the smooth decline in performance with number of targets, although there is no agreement about what precisely about tracking becomes worse when less resource is provided. Possibilities include spatial resolution, temporal resolution, the maximum speed of the tracker, or all three (see § Spatiotemporal limits).
References
This article was adapted from the following source under a CC BY 4.0 license (2023) (reviewer reports): Alex O. Holcombe (15 April 2023). "Multiple object tracking" (PDF). WikiJournal of Science. 6 (1): 3. doi:10.15347/WJS/2023.003. ISSN 2470-6345. Wikidata Q115162234.
- ^ Pylyshyn, Z. W.; Storm, R. W. (1988). "Tracking multiple independent targets: Evidence for a parallel tracking mechanism". Spatial Vision. 3 (3): 179–197. doi:10.1163/156856888X00122. PMID 3153671. S2CID 1433436.
- Scholl, Brian J. (2008). "What Have We Learned about Attention from Multiple-Object Tracking (and Vice Versa)?". In Dedrick, Don; Trick, Lana (eds.). Computation, cognition, and Pylyshyn. MIT Press. pp. 49–78. doi:10.7551/mitpress/8135.003.0005. ISBN 9780262255196.
- Edwards, Grace; Berestova, Anna; Battelli, Lorella (2021-09-29). "Behavioral gain following isolation of attention". Scientific Reports. 11 (1): 19329. Bibcode:2021NatSR..1119329E. doi:10.1038/s41598-021-98670-w. ISSN 2045-2322. PMC 8481494. PMID 34588526.
- ^ Holcombe, A. O.; Chen, W.- Y.; Howe, P. D. L. (2014-08-01). "Object tracking: Absence of long-range spatial interference supports resource theories". Journal of Vision. 14 (6): 1. doi:10.1167/14.6.1. ISSN 1534-7362. PMID 25086084.
- Holcombe, Alex O. (2023). Attending to moving objects. Cambridge University Press. Section 2. doi:10.1017/9781009003414. ISBN 9781009003414. S2CID 256170538.
- Holcombe 2023, Section 3.
- Alvarez, George A.; Franconeri, Steven L. (2007-10-30). "How many objects can you track?: Evidence for a resource-limited attentive tracking mechanism". Journal of Vision. 7 (13): 14.1–10. doi:10.1167/7.13.14. ISSN 1534-7362. PMID 17997642.
- Alvarez, George A.; Cavanagh, Patrick (August 2005). "Independent Resources for Attentional Tracking in the Left and Right Visual Hemifields". Psychological Science. 16 (8): 637–643. doi:10.1111/j.1467-9280.2005.01587.x. ISSN 0956-7976. PMID 16102067. S2CID 590734.
- ^ Holcombe, Alex O.; Chen, Wei-Ying (May 2012). "Exhausting attentional tracking resources with a single fast-moving object". Cognition. 123 (2): 218–228. doi:10.1016/j.cognition.2011.10.003. hdl:2123/7868. PMID 22055340. S2CID 20494664.
- Holcombe 2023, Section 6.
- ^ Intriligator, James; Cavanagh, Patrick (November 2001). "The Spatial Resolution of Visual Attention". Cognitive Psychology. 43 (3): 171–216. doi:10.1006/cogp.2001.0755. PMID 11689021. S2CID 18050760.
- ^ Verstraten, Frans A.J; Cavanagh, Patrick; Labianca, Angela T (December 2000). "Limits of attentive tracking reveal temporal properties of attention". Vision Research. 40 (26): 3651–3664. doi:10.1016/S0042-6989(00)00213-3. PMID 11116167. S2CID 12270476.
- ^ Holcombe, A. O.; Chen, W.-Y. (2013-01-09). "Splitting attention reduces temporal resolution from 7 Hz for tracking one object to". Journal of Vision. 13 (1): 12. doi:10.1167/13.1.12. ISSN 1534-7362. PMID 23302215.
- ^ Roudaia, Eugenie; Faubert, Jocelyn (2017-09-01). "Different effects of aging and gender on the temporal resolution in attentional tracking". Journal of Vision. 17 (11): 1. doi:10.1167/17.11.1. ISSN 1534-7362. PMID 28862709.
- Holcombe 2023, Section 4.
- Clark, Andy (2016). Surfing uncertainty: Prediction, action, and the embodied mind. Oxford. doi:10.1093/acprof:oso/9780190217013.001.0001. ISBN 978-0-19-021701-3. OCLC 904011681.
{{cite book}}
: CS1 maint: location missing publisher (link) - Hohwy, Jakob (2013). The predictive mind (First ed.). Oxford. doi:10.1093/acprof:oso/9780199682737.001.0001. ISBN 978-0-19-150519-5. OCLC 868923880.
{{cite book}}
: CS1 maint: location missing publisher (link) - Franconeri, Steven L.; Pylyshyn, Zenon W.; Scholl, Brian J. (May 2012). "A simple proximity heuristic allows tracking of multiple objects through occlusion". Attention, Perception, & Psychophysics. 74 (4): 691–702. doi:10.3758/s13414-011-0265-9. ISSN 1943-3921. PMID 22271165. S2CID 256119018.
- Keane, B; Pylyshyn, Z (June 2006). "Is motion extrapolation employed in multiple object tracking? Tracking as a low-level, non-predictive function☆". Cognitive Psychology. 52 (4): 346–368. doi:10.1016/j.cogpsych.2005.12.001. PMID 16442088. S2CID 5771001.
- Howard, Christina J.; Masom, David; Holcombe, Alex O. (September 2011). "Position representations lag behind targets in multiple object tracking". Vision Research. 51 (17): 1907–1919. doi:10.1016/j.visres.2011.07.001. PMID 21762715. S2CID 14555811.
- Howard, Christina J.; Holcombe, Alex O. (April 2008). "Tracking the changing features of multiple objects: Progressively poorer perceptual precision and progressively greater perceptual lag". Vision Research. 48 (9): 1164–1180. doi:10.1016/j.visres.2008.01.023. PMID 18359501. S2CID 8485280.
- ^ Fencsik, David E.; Klieger, Sarah B.; Horowitz, Todd S. (May 2007). "The role of location and motion information in the tracking and recovery of moving objects". Perception & Psychophysics. 69 (4): 567–577. doi:10.3758/BF03193914. ISSN 0031-5117. PMID 17727110. S2CID 24515387.
- ^ Howe, P. D. L.; Holcombe, A. O. (2012-12-10). "Motion information is sometimes used as an aid to the visual tracking of objects". Journal of Vision. 12 (13): 10. doi:10.1167/12.13.10. ISSN 1534-7362. PMID 23232339.
- ^ Luu, Tina; Howe, Piers D. L. (August 2015). "Extrapolation occurs in multiple object tracking when eye movements are controlled". Attention, Perception, & Psychophysics. 77 (6): 1919–1929. doi:10.3758/s13414-015-0891-8. ISSN 1943-3921. PMID 25893469. S2CID 256207631.
- ^ Wang, Yang; Vul, Edward (2021-03-26). "The role of kinematic properties in multiple object tracking". Journal of Vision. 21 (3): 22. doi:10.1167/jov.21.3.22. ISSN 1534-7362. PMC 7998010. PMID 33769442.
- Tripathy, Srimant P.; Barrett, Brendan T. (2004-12-09). "Severe loss of positional information when detecting deviations in multiple trajectories". Journal of Vision. 4 (12): 1020–1043. doi:10.1167/4.12.4. ISSN 1534-7362. PMID 15669909.
- Yantis, Steven (July 1992). "Multielement visual tracking: Attention and perceptual organization". Cognitive Psychology. 24 (3): 295–340. doi:10.1016/0010-0285(92)90010-Y. PMID 1516359. S2CID 974635.
- Merkel, Christian; Stoppel, Christian M.; Hillyard, Steven A.; Heinze, Hans-Jochen; Hopf, Jens-Max; Schoenfeld, Mircea Ariel (2014-01-01). "Spatio-temporal Patterns of Brain Activity Distinguish Strategies of Multiple-object Tracking". Journal of Cognitive Neuroscience. 26 (1): 28–40. doi:10.1162/jocn_a_00455. ISSN 0898-929X. PMID 23915053. S2CID 11744449.
- Merkel, Christian; Hopf, Jens-Max; Schoenfeld, Mircea Ariel (February 2017). "Spatio-temporal dynamics of attentional selection stages during multiple object tracking". NeuroImage. 146: 484–491. doi:10.1016/j.neuroimage.2016.10.046. PMID 27810524. S2CID 3389532.
- Bill, Johannes; Pailian, Hrag; Gershman, Samuel J.; Drugowitsch, Jan (2020-09-29). "Hierarchical structure is employed by humans during visual motion perception". Proceedings of the National Academy of Sciences. 117 (39): 24581–24589. Bibcode:2020PNAS..11724581B. doi:10.1073/pnas.2008961117. ISSN 0027-8424. PMC 7533882. PMID 32938799.
- Pylyshyn, Zenon (October 2004). "Some puzzling findings in multiple object tracking: I. Tracking without keeping track of object identities". Visual Cognition. 11 (7): 801–822. doi:10.1080/13506280344000518. ISSN 1350-6285. S2CID 14717612.
- Horowitz, Todd S.; Klieger, Sarah B.; Fencsik, David E.; Yang, Kevin K.; Alvarez, George A.; Wolfe, Jeremy M. (February 2007). "Tracking unique objects". Perception & Psychophysics. 69 (2): 172–184. doi:10.3758/BF03193740. ISSN 0031-5117. PMID 17557588. S2CID 8138353.
- Pailian, Hrag; Carey, Susan E.; Halberda, Justin; Pepperberg, Irene M. (December 2020). "Age and Species Comparisons of Visual Mental Manipulation Ability as Evidence for its Development and Evolution". Scientific Reports. 10 (1): 7689. Bibcode:2020NatSR..10.7689P. doi:10.1038/s41598-020-64666-1. ISSN 2045-2322. PMC 7203154. PMID 32376944.
- Kahneman, Daniel; Treisman, Anne; Gibbs, Brian J (April 1992). "The reviewing of object files: Object-specific integration of information". Cognitive Psychology. 24 (2): 175–219. doi:10.1016/0010-0285(92)90007-O. PMID 1582172. S2CID 2688060.
- Mitroff, Stephen R.; Scholl, Brian J.; Wynn, Karen (May 2005). "The relationship between object files and conscious perception". Cognition. 96 (1): 67–92. doi:10.1016/j.cognition.2004.03.008. PMID 15833307. S2CID 9043690.
- Saiki, J.; Holcombe, A. O. (2012-03-06). "Blindness to a simultaneous change of all elements in a scene, unless there is a change in summary statistics". Journal of Vision. 12 (3): 2. doi:10.1167/12.3.2. ISSN 1534-7362. PMID 22396462.
- Suchow, Jordan W.; Alvarez, George A. (January 2011). "Motion Silences Awareness of Visual Change". Current Biology. 21 (2): 140–143. Bibcode:2011CBio...21..140S. doi:10.1016/j.cub.2010.12.019. PMID 21215632. S2CID 10500810.
- Blaser, Erik; Pylyshyn, Zenon W.; Holcombe, Alex O. (November 2000). "Tracking an object through feature space". Nature. 408 (6809): 196–199. Bibcode:2000Natur.408..196B. doi:10.1038/35041567. ISSN 0028-0836. PMID 11089972. S2CID 4418346.
- ^ Howe, Piers D.; Incledon, Natalie C.; Little, Daniel R. (2012-07-30). de Fockert, Jan (ed.). "Can Attention Be Confined to Just Part of a Moving Object? Revisiting Target-Distractor Merging in Multiple Object Tracking". PLOS ONE. 7 (7): e41491. Bibcode:2012PLoSO...741491H. doi:10.1371/journal.pone.0041491. ISSN 1932-6203. PMC 3408494. PMID 22859990.
- Scholl, Brian J; Pylyshyn, Zenon W; Feldman, Jacob (June 2001). "What is a visual object? Evidence from target merging in multiple object tracking". Cognition. 80 (1–2): 159–177. doi:10.1016/S0010-0277(00)00157-8. PMID 11245843. S2CID 7053492.
- Holcombe 2023, Section 7.4.
- Wolfe, Jeremy M.; Bennett, Sara C. (January 1997). "Preattentive Object Files: Shapeless Bundles of Basic Features". Vision Research. 37 (1): 25–43. doi:10.1016/S0042-6989(96)00111-3. PMID 9068829. S2CID 16189579.
- Anstis, S. (1990). Imperceptible intersections: The chopstick illusion. In A. Blake and T. Troscianko (Eds.), AI and the Eye. London: Wiley and Sons Ltd., 105-117.
- vanMarle, Kristy; Scholl, Brian J. (September 2003). "Attentive Tracking of Objects Versus Substances". Psychological Science. 14 (5): 498–504. doi:10.1111/1467-9280.03451. ISSN 0956-7976. PMID 12930483. S2CID 15083705.
- ^ Alvarez, George A.; Horowitz, Todd S.; Arsenio, Helga C.; DiMase, Jennifer S.; Wolfe, Jeremy M. (2005). "Do Multielement Visual Tracking and Visual Search Draw Continuously on the Same Visual Attention Resources?". Journal of Experimental Psychology: Human Perception and Performance. 31 (4): 643–667. doi:10.1037/0096-1523.31.4.643. ISSN 1939-1277. PMID 16131240.
- Wahn, Basil; König, Peter (2015-07-29). "Audition and vision share spatial attentional resources, yet attentional load does not disrupt audiovisual integration". Frontiers in Psychology. 6: 1084. doi:10.3389/fpsyg.2015.01084. ISSN 1664-1078. PMC 4518141. PMID 26284008.
- Wahn, Basil; König, Peter (2015). "Vision and Haptics Share Spatial Attentional Resources and Visuotactile Integration Is Not Affected by High Attentional Load". Multisensory Research. 28 (3–4): 371–392. doi:10.1163/22134808-00002482. ISSN 2213-4794. PMID 26288905.
- Arrighi, Roberto; Lunardi, Roy; Burr, David (2011). "Vision and Audition Do Not Share Attentional Resources in Sustained Tasks". Frontiers in Psychology. 2: 56. doi:10.3389/fpsyg.2011.00056. ISSN 1664-1078. PMC 3110771. PMID 21734893.
- Fougnie, Daryl; Cockhren, Jurnell; Marois, René (August 2018). "A common source of attention for auditory and visual tracking". Attention, Perception, & Psychophysics. 80 (6): 1571–1583. doi:10.3758/s13414-018-1524-9. ISSN 1943-3921. PMC 6061001. PMID 29717471.
- Jovicich, Jorge; Peters, Robert J.; Koch, Christof; Braun, Jochen; Chang, Linda; Ernst, Thomas (2001-11-15). "Brain Areas Specific for Attentional Load in a Motion-Tracking Task". Journal of Cognitive Neuroscience. 13 (8): 1048–1058. doi:10.1162/089892901753294347. ISSN 0898-929X. PMID 11784443. S2CID 10836232.
- Culham, Jody C; Cavanagh, Patrick; Kanwisher, Nancy G (November 2001). "Attention Response Functions". Neuron. 32 (4): 737–745. doi:10.1016/S0896-6273(01)00499-8. PMID 11719212. S2CID 14414579.
- ^ Alnaes, D.; Sneve, M. H.; Espeseth, T.; Endestad, T.; van de Pavert, S. H. P.; Laeng, B. (2014-04-01). "Pupil size signals mental effort deployed during multiple object tracking and predicts brain activity in the dorsal attention network and the locus coeruleus". Journal of Vision. 14 (4): 1. doi:10.1167/14.4.1. ISSN 1534-7362. PMID 24692319. S2CID 11688513.
- Wahn, Basil; Ferris, Daniel P.; Hairston, W. David; König, Peter (2016-12-15). Price, Nicholas Seow Chiang (ed.). "Pupil Sizes Scale with Attentional Load and Task Experience in a Multiple Object Tracking Task". PLOS ONE. 11 (12): e0168087. Bibcode:2016PLoSO..1168087W. doi:10.1371/journal.pone.0168087. ISSN 1932-6203. PMC 5157994. PMID 27977762.
- Holcombe 2023, Section 9.6.
- Mesulam, M.-Marsel (1999-07-29). Howseman, A.; Zeki, S. (eds.). "Spatial attention and neglect: parietal, frontal and cingulate contributions to the mental representation and attentional targeting of salient extrapersonal events". Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences. 354 (1387): 1325–1346. doi:10.1098/rstb.1999.0482. ISSN 0962-8436. PMC 1692628. PMID 10466154.
- Drew, T.; Vogel, E. K. (2008-04-16). "Neural Measures of Individual Differences in Selecting and Tracking Multiple Moving Objects". Journal of Neuroscience. 28 (16): 4183–4191. doi:10.1523/JNEUROSCI.0556-08.2008. ISSN 0270-6474. PMC 2570324. PMID 18417697.
- ^ Huang, Liqiang; Mo, Lei; Li, Ying (April 2012). "Measuring the interrelations among multiple paradigms of visual attention: An individual differences approach". Journal of Experimental Psychology: Human Perception and Performance. 38 (2): 414–428. doi:10.1037/a0026314. ISSN 1939-1277. PMID 22250865.
- Wilbiks, Jonathan M. P.; Beatteay, Annika (October 2020). "Individual differences in multiple object tracking, attentional cueing, and age account for variability in the capacity of audiovisual integration". Attention, Perception, & Psychophysics. 82 (7): 3521–3543. doi:10.3758/s13414-020-02062-7. ISSN 1943-3921. PMID 32529573. S2CID 219606656.
- ^ Treviño, Melissa; Zhu, Xiaoshu; Lu, Yi Yi; Scheuer, Luke S.; Passell, Eliza; Huang, Grace C.; Germine, Laura T.; Horowitz, Todd S. (December 2021). "How do we measure attention? Using factor analysis to establish construct validity of neuropsychological tests". Cognitive Research: Principles and Implications. 6 (1): 51. doi:10.1186/s41235-021-00313-1. ISSN 2365-7464. PMC 8298746. PMID 34292418.
- Eayrs, Joshua; Lavie, Nilli (August 2018). "Establishing individual differences in perceptual capacity". Journal of Experimental Psychology: Human Perception and Performance. 44 (8): 1240–1257. doi:10.1037/xhp0000530. ISSN 1939-1277. PMID 29578735. S2CID 4422544.
- Meyerhoff, Hauke S.; Papenmeier, Frank (December 2020). "Individual differences in visual attention: A short, reliable, open-source, and multilingual test of multiple object tracking in PsychoPy". Behavior Research Methods. 52 (6): 2556–2566. doi:10.3758/s13428-020-01413-4. ISSN 1554-3528. PMID 32495028. S2CID 256203146.
- ^ Oksama, Lauri; Hyönä, Jukka (July 2004). "Is multiple object tracking carried out automatically by an early vision mechanism independent of higher-order cognition? An individual difference approach". Visual Cognition. 11 (5): 631–671. doi:10.1080/13506280344000473. ISSN 1350-6285. S2CID 144881546.
- Trick, Lana M.; Jaspers-Fayer, Fern; Sethi, Naina (2005-07-01). "Multiple-object tracking in children: The "Catch the Spies" task". Cognitive Development. 20 (3): 373–387. doi:10.1016/j.cogdev.2005.05.009. ISSN 0885-2014. S2CID 655920.
- ^ Dye, Matthew W. G.; Bavelier, Daphne (2010-02-22). "Differential development of visual attention skills in school-age children". Vision Research. Perceptual Learning Part II. 50 (4): 452–459. doi:10.1016/j.visres.2009.10.010. ISSN 0042-6989. PMC 2824025. PMID 19836409.
- ^ Koldewyn, Kami; Weigelt, Sarah; Kanwisher, Nancy; Jiang, Yuhong (June 2013). "Multiple Object Tracking in Autism Spectrum Disorders". Journal of Autism and Developmental Disorders. 43 (6): 1394–1405. doi:10.1007/s10803-012-1694-6. ISSN 0162-3257. PMC 3581699. PMID 23104619.
- ^ O'Hearn, Kirsten; Franconeri, Steven; Wright, Catherine; Minshew, Nancy; Luna, Beatriz (April 2013). "The development of individuation in autism". Journal of Experimental Psychology: Human Perception and Performance. 39 (2): 494–509. doi:10.1037/a0029400. ISSN 1939-1277. PMC 3608798. PMID 22963232.
- Mervis, Carolyn B.; Robinson, Byron F.; Pani, John R. (November 1999). "Visuospatial Construction". The American Journal of Human Genetics. 65 (5): 1222–1229. doi:10.1086/302633. PMC 1288273. PMID 10521286.
- Ferrara, Katrina; Hoffman, James E.; O’Hearn, Kirsten; Landau, Barbara (2016-08-07). "Constraints on Multiple Object Tracking in Williams Syndrome: How Atypical Development Can Inform Theories of Visual Processing". Journal of Cognition and Development. 17 (4): 620–641. doi:10.1080/15248372.2016.1195389. ISSN 1524-8372. S2CID 4677194.
- O’Hearn, Kirsten; Hoffman, James E.; Landau, Barbara (May 2010). "Developmental profiles for multiple object tracking and spatial memory: typically developing preschoolers and people with Williams syndrome: Multiple object tracking in preschool children and WS". Developmental Science. 13 (3): 430–440. doi:10.1111/j.1467-7687.2009.00893.x. PMC 2927133. PMID 20443964.
- Sekuler, Robert; McLaughlin, Chris; Yotsumoto, Yuko (June 2008). "Age-Related Changes in Attentional Tracking of Multiple Moving Objects". Perception. 37 (6): 867–876. doi:10.1068/p5923. ISSN 0301-0066. PMID 18686706. S2CID 879560.
- Kennedy, G. J.; Tripathy, S. P.; Barrett, B. T. (2009-02-01). "Early age-related decline in the effective number of trajectories tracked in adult human vision". Journal of Vision. 9 (2): 21.1–10. doi:10.1167/9.2.21. ISSN 1534-7362. PMID 19271931.
- Scialfa, C. T.; Cordazzo, S.; Bubric, K.; Lyon, J. (2013-07-01). "Aging and Visual Crowding". The Journals of Gerontology Series B: Psychological Sciences and Social Sciences. 68 (4): 522–528. doi:10.1093/geronb/gbs086. ISSN 1079-5014. PMID 23009956.
- Green, C. S.; Bavelier, D. (2006-08-01). "Enumeration versus multiple object tracking: the case of action video game players". Cognition. 101 (1): 217–245. doi:10.1016/j.cognition.2005.10.004. ISSN 0010-0277. PMC 2896820. PMID 16359652.
- Hilgard, Joseph; Sala, Giovanni; Boot, Walter R.; Simons, Daniel J. (2019-01-01). "Overestimation of Action-Game Training Effects: Publication Bias and Salami Slicing". Collabra: Psychology. 5 (1). doi:10.1525/collabra.231. ISSN 2474-7394. S2CID 198617728.
- Fortenbaugh, Francesca C.; DeGutis, Joseph; Germine, Laura; Wilmer, Jeremy B.; Grosso, Mallory; Russo, Kathryn; Esterman, Michael (September 2015). "Sustained Attention Across the Life Span in a Sample of 10,000: Dissociating Ability and Strategy". Psychological Science. 26 (9): 1497–1510. doi:10.1177/0956797615594896. ISSN 0956-7976. PMC 4567490. PMID 26253551.
- Horowitz, Todd S.; Birnkrant, Randall S.; Fencsik, David E.; Tran, Linda; Wolfe, Jeremy M. (June 2006). "How do we track invisible objects?". Psychonomic Bulletin & Review. 13 (3): 516–523. doi:10.3758/BF03193879. ISSN 1069-9384. PMID 17048740. S2CID 9749474.
- Redick, Thomas S.; Engle, Randall W. (July 2006). "Working memory capacity and attention network test performance". Applied Cognitive Psychology. 20 (5): 713–721. doi:10.1002/acp.1224. ISSN 0888-4080.
- Mashburn, Cody A.; Tsukahara, Jason S.; Engle, Randall W. (2020-11-05). Individual Differences in Attention Control: Implications for the Relationship Between Working Memory Capacity and Fluid Intelligence. Oxford University Press. pp. 175–211. doi:10.1093/oso/9780198842286.003.0007. ISBN 978-0-19-884228-6.
- ^ Schonbrun, Zach (2017-01-04). "Keep Your Eye on the Balls to Become a Better Athlete". The New York Times. ISSN 0362-4331. Retrieved 2022-10-06.
- Vater, Christian; Gray, Rob; Holcombe, Alex O. (October 2021). "A critical systematic review of the Neurotracker perceptual-cognitive training tool". Psychonomic Bulletin & Review. 28 (5): 1458–1483. doi:10.3758/s13423-021-01892-2. ISSN 1069-9384. PMC 8500884. PMID 33821464.
- Simons, Daniel J.; Boot, Walter R.; Charness, Neil; Gathercole, Susan E.; Chabris, Christopher F.; Hambrick, David Z.; Stine-Morrow, Elizabeth A. L. (October 2016). "Do "Brain-Training" Programs Work?". Psychological Science in the Public Interest. 17 (3): 103–186. doi:10.1177/1529100616661983. ISSN 1529-1006. PMID 27697851. S2CID 13729927.
- Bowers, Alex R.; Anastasio, R. Julius; Sheldon, Sarah S.; O’Connor, Margaret G.; Hollis, Ann M.; Howe, Piers D.; Horowitz, Todd S. (October 2013). "Can we improve clinical prediction of at-risk older drivers?". Accident Analysis & Prevention. 59: 537–547. doi:10.1016/j.aap.2013.06.037. PMC 3769510. PMID 23954688.
- Mackenzie, Andrew K.; Harris, Julie M. (February 2017). "A link between attentional function, effective eye movements, and driving ability". Journal of Experimental Psychology: Human Perception and Performance. 43 (2): 381–394. doi:10.1037/xhp0000297. ISSN 1939-1277. PMC 5279462. PMID 27893270.
- Mackenzie, Andrew K.; Vernon, Mike L.; Cox, Paul R.; Crundall, David; Daly, Rosie C.; Guest, Duncan; Muhl-Richardson, Alexander; Howard, Christina J. (June 2022). "The Multiple Object Avoidance (MOA) task measures attention for action: Evidence from driving and sport". Behavior Research Methods. 54 (3): 1508–1529. doi:10.3758/s13428-021-01679-2. ISSN 1554-3528. PMC 9170642. PMID 34786653.
- Holcombe 2023, Section 12.
- ^ Oksama, Lauri; Hyönä, Jukka (January 2016). "Position tracking and identity tracking are separate systems: Evidence from eye movements". Cognition. 146: 393–409. doi:10.1016/j.cognition.2015.10.016. PMID 26529194. S2CID 14749878.
- ^ Li, Jie; Oksama, Lauri; Hyönä, Jukka (January 2019). "Model of Multiple Identity Tracking (MOMIT) 2.0: Resolving the serial vs. parallel controversy in tracking". Cognition. 182: 260–274. doi:10.1016/j.cognition.2018.10.016. PMID 30384128. S2CID 53181791.
- ^ Lovett, Andrew; Bridewell, Will; Bello, Paul (2019-12-23). "Selection enables enhancement: An integrated model of object tracking". Journal of Vision. 19 (14): 23. doi:10.1167/19.14.23. ISSN 1534-7362. PMID 31868894. S2CID 209446017.
- ^ Kazanovich, Yakov; Borisyuk, Roman (June 2006). "An Oscillatory Neural Model of Multiple Object Tracking". Neural Computation. 18 (6): 1413–1440. doi:10.1162/neco.2006.18.6.1413. ISSN 0899-7667. PMID 16764509. S2CID 13947567.
- Alvarez, George A.; Franconeri, Steven L. (2007-10-30). "How many objects can you track?: Evidence for a resource-limited attentive tracking mechanism". Journal of Vision. 7 (13): 14.1–10. doi:10.1167/7.13.14. ISSN 1534-7362. PMID 17997642.
- Vul, E.; Frank, M.; Tenenbaum, J.; Alvarez, G. A. (2009). "Explaining human multiple object tracking as resource-constrained approximate inference in a dynamic probabilistic model". In Bengio, Y.; Schuurmans, D.; Lafferty, J.; Williams, C.; Culotta, A. (eds.). Advances in Neural Information Processing Systems (PDF). Vol. 22. Neural Information Processing Systems. pp. 1955–1963. ISBN 9781615679119.
External links
- See Yale Perception and Cognition laboratory webpage for an example of a typical multiple object tracking task.