Misplaced Pages

Predictive analytics: Difference between revisions

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
Browse history interactively← Previous editNext edit →Content deleted Content addedVisualWikitext
Revision as of 12:35, 20 March 2023 editDanielsltt (talk | contribs)Extended confirmed users22,269 edits →Further reading← Previous edit Revision as of 16:53, 24 March 2023 edit undoEricVSiegel (talk | contribs)19 editsNo edit summaryNext edit →
(5 intermediate revisions by the same user not shown)
Line 2: Line 2:
{{More citations needed|date=June 2011}} {{More citations needed|date=June 2011}}


'''Predictive analytics''' encompasses a variety of ] techniques from ], ], and ] that analyze current and historical facts to make ]s about future or otherwise unknown events.<ref name=":52">{{Cite web |title=To predict or not to Predict |url=https://mccoy-partners.com/updates/to-predict-or-not-to-predict |access-date=2022-05-05 |website=mccoy-partners.com}}</ref> '''Predictive analytics''' is the application of ] to generate a ] for certain business applications. As such, it encompasses a variety of ] techniques from ] and ] that analyze current and historical facts to make ]s about future or otherwise unknown events.<ref name=":52">{{Cite web |title=To predict or not to Predict |url=https://mccoy-partners.com/updates/to-predict-or-not-to-predict |access-date=2022-05-05 |website=mccoy-partners.com}}</ref> It represents a major subset of ] applications; in some contexts, it is synonymous with ].<ref>{{Cite book |last=Siegel |first=Eric |title=Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die (1st ed.) |publisher=] |year=2013 |isbn=978-1-1183-5685-2 |language=English}}</ref>


In business, predictive models exploit ] found in historical and transactional data to identify risks and opportunities. Models capture relationships among many factors to allow assessment of risk or potential associated with a particular set of conditions, guiding ] for candidate transactions.<ref>{{Cite book |last=Coker |first=Frank |title=Pulse: Understanding the Vital Signs of Your Business (1st ed.) |location=Bellevue, WA |publisher=Ambient Light Publishing |year=2014 |isbn=978-0-9893086-0-1 |pages=30, 39, 42, more}}</ref> In business, predictive models exploit ] found in historical and transactional data to identify risks and opportunities. Models capture relationships among many factors to allow assessment of risk or potential associated with a particular set of conditions, guiding ] for candidate transactions.<ref>{{Cite book |last=Coker |first=Frank |title=Pulse: Understanding the Vital Signs of Your Business (1st ed.) |location=Bellevue, WA |publisher=Ambient Light Publishing |year=2014 |isbn=978-0-9893086-0-1 |pages=30, 39, 42, more}}</ref>

Revision as of 16:53, 24 March 2023

Statistical techniques analyzing facts to make predictions about unknown events
This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.
Find sources: "Predictive analytics" – news · newspapers · books · scholar · JSTOR (June 2011) (Learn how and when to remove this message)

Predictive analytics is the application of machine learning to generate a predictive model for certain business applications. As such, it encompasses a variety of statistical techniques from predictive modeling and machine learning that analyze current and historical facts to make predictions about future or otherwise unknown events. It represents a major subset of machine learning applications; in some contexts, it is synonymous with machine learning.

In business, predictive models exploit patterns found in historical and transactional data to identify risks and opportunities. Models capture relationships among many factors to allow assessment of risk or potential associated with a particular set of conditions, guiding decision-making for candidate transactions.

The defining functional effect of these technical approaches is that predictive analytics provides a predictive score (probability) for each individual (customer, employee, healthcare patient, product SKU, vehicle, component, machine, or other organizational unit) in order to determine, inform, or influence organizational processes that pertain across large numbers of individuals, such as in marketing, credit risk assessment, fraud detection, manufacturing, healthcare, and government operations including law enforcement.

Definition

Predictive analytics is a set of business intelligence (BI) technologies that uncovers relationships and patterns within large volumes of data that can be used to predict behavior and events. Unlike other BI technologies, predictive analytics is forward-looking, using past events to anticipate the future. Predictive analytics statistical techniques include data modeling, machine learning, AI, deep learning algorithms and data mining. Often the unknown event of interest is in the future, but predictive analytics can be applied to any type of unknown whether it be in the past, present or future. For example, identifying suspects after a crime has been committed, or credit card fraud as it occurs. The core of predictive analytics relies on capturing relationships between explanatory variables and the predicted variables from past occurrences, and exploiting them to predict the unknown outcome. It is important to note, however, that the accuracy and usability of results will depend greatly on the level of data analysis and the quality of assumptions.

Predictive analytics is often defined as predicting at a more detailed level of granularity, i.e., generating predictive scores (probabilities) for each individual organizational element. This distinguishes it from forecasting. For example, "Predictive analytics—Technology that learns from experience (data) to predict the future behavior of individuals in order to drive better decisions." In future industrial systems, the value of predictive analytics will be to predict and prevent potential issues to achieve near-zero break-down and further be integrated into prescriptive analytics for decision optimization.

Big Data

While there is no universal definition of big data, most of them refer to the processing of a large set of data points to get a finished product. When the dataset is too large to be analyzed using traditional analysis techniques, big data analytics comes into play. However, size is not the only factor that defines big data.

Gartner's definition of big data is useful in explaining the defining properties of big data: "Big data is high-volume, high-velocity and/or high variety information assets that demand cost-effective, innovative forms of information processing that enable enhanced insight, decision making, and process automation." These properties are sometimes referred to as the 3 Vs of big data.

When we talk about volume of data, think about its size. There is no universal criteria for size that determines whether a dataset is "big" or not, because size is relative. Terabytes of data could be considered big data to one firm while another firm uses a larger unit of storage as criteria for big data such as a petabyte or an exabyte.

The velocity of data refers to the speed of data and how much time it takes to create, store, and analyze it. Batch processing was traditionally used to process large blocks of data, but this takes a lot of time and is only useful if decision making can be successful without fast-paced data processing. The markets of the modern day however require real-time processing for powerful and successful decision making in highly versatile and competitive environments.

There are also a few different types of data, which is what Gartner means by variety. Data can be structured, semi-structured, or unstructured. "Structured data is data that adheres to a predefined data model and is therefore straightforward to analyze." Structured data generally has rows and columns that can be sorted and searched with basic techniques. Spreadsheets and relational databases are typical examples of structured data. Unstructured data is basically the opposite of structured data in that it doesn't adhere to a predefined data model and doesn't contain columns or rows to help organize the data. This makes unstructured data more difficult to understand than structured data, which can be easily processed using traditional programs like Excel and SQL. Some examples of unstructured data include emails, PDF files, and Google searches. Storing and processing unstructured data has become much easier in recent years due to programs like Power BI and Tableau.

"Semi-structured data lies in between structured and unstructured data. It does not adhere to a formal data structure yet does contain tags and other markers to organize the data." The semi-structured category of data is much easier to analyze than unstructured data. Many big data tools can 'read' and process semi-structured forms of data like XML or JSON files.

The volume, variety and velocity of big data have introduced challenges across the board for capture, storage, search, sharing, analysis, and visualization. Examples of big data sources include web logs, RFID, sensor data, social networks, Internet search indexing, call detail records, military surveillance, and complex data in astronomic, biogeochemical, genomics, and atmospheric sciences. Thanks to technological advances in computer hardware—faster CPUs, cheaper memory, and MPP architectures—and new technologies such as Hadoop, MapReduce, and in-database and text analytics for processing big data, it is now feasible to collect, analyze, and mine massive amounts of structured and unstructured data for new insights. It is also possible to run predictive algorithms on streaming data. Today, exploring big data and using predictive analytics is within reach of more organizations than ever before and new methods that are capable of handling such datasets are proposed.

Analytical Techniques

The approaches and techniques used to conduct predictive analytics can broadly be grouped into regression techniques and machine learning techniques.

Machine Learning

Machine learning can be defined as the ability of a machine to learn and then mimic human behavior that requires intelligence. This is accomplished through artificial intelligence, algorithms, and models.

Autoregressive Integrated Moving Average (ARIMA)

ARIMA models are a common example of time series models. These models use autoregression, which means the model can be fitted with a regression software that will use machine learning to do most of the regression analysis and smoothing. ARIMA models are known to have no overall trend, but instead have a variation around the average that has a constant amplitude, resulting in statistically similar time patterns. Through this, variables are analyzed and data is filtered in order to better understand and predict future values.

One example of an ARIMA method is exponential smoothing models. Exponential smoothing takes into account the difference in importance between older and newer data sets, as the more recent data is more accurate and valuable in predicting future values. In order to accomplish this, exponents are utilized to give newer data sets a larger weight in the calculations than the older sets.

Time Series Models

Time series models are a subset of machine learning that utilize time series in order to understand and forecast data using past values. A time series is the sequence of a variable's value over equally spaced periods, such as years or quarters in business applications. To accomplish this, the data must be smoothed, or the random variance of the data must be removed in order to reveal trends in the data. There are multiple ways to accomplish this.

Single Moving Average

Single moving average methods utilize smaller and smaller numbered sets of past data to decrease error that is associated with taking a single average, making it a more accurate average than it would be to take the average of the entire data set.

Centered Moving Average

Centered moving average methods utilize the data found in the single moving average methods by taking an average of the median-numbered data set. However, as the median-numbered data set is difficult to calculate with even-numbered data sets, this method works better with odd-numbered data sets than even.

Predictive Modeling

Predictive Modeling is a statistical technique used to predict future behavior. It utilizes predictive models to analyze a relationship between a specific unit in a given sample and one or more features of the unit. The objective of these models is to assess the possibility that a unit in another sample will display the same pattern. Predictive model solutions can be considered a type of data mining technology. The models can analyze both historical and current data and generate a model in order to predict potential future outcomes.

Regardless of the methodology used, in general, the process of creating predictive models involves the same steps. First, it is necessary to determine the project objectives and desired outcomes and translate these into predictive analytic objectives and tasks. Then, analyze the source data to determine the most appropriate data and model building approach (models are only as useful as the applicable data used to build them). Select and transform the data in order to create models. Create and test models in order to evaluate if they are valid and will be able to meet project goals and metrics. Apply the model's results to appropriate business processes (identifying patterns in the data doesn't necessarily mean a business will understand how to take advantage or capitalize on it). Afterward, manage and maintain models in order to standardize and improve performance (demand will increase for model management in order to meet new compliance regulations).

Regression Techniques

Generally, regression analysis uses structural data along with the past values of independent variables and the relationship between them and the dependent variable to form predictions.

Linear Regression

In linear regression, a plot is constructed with the previous values of the dependent variable plotted on the Y-axis and the independent variable that is being analyzed plotted on the X-axis. A regression line is then constructed by a statistical program representing the relationship between the independent and dependent variables which can be used to predict values of the dependent variable based only on the independent variable. With the regression line, the program also shows a slope intercept equation for the line which includes an addition for the error term of the regression, where the higher the value of the error term the less precise the regression model is. In order to decrease the value of the error term, other independent variables are introduced to the model, and similar analyses are performed on these independent variables.

Applications

Analytical Review and Conditional Expectations in Auditing

An important aspect of auditing includes analytical review. In analytical review, the reasonableness of reported account balances being investigated is determined. Auditors accomplish this process through predictive modeling to form predictions called conditional expectations of the balances being audited using autoregressive integrated moving average (ARIMA) methods and general regression analysis methods, specifically through the Statistical Technique for Analytical Review (STAR) methods.

The ARIMA method for analytical review uses time-series analysis on past audited balances in order to create the conditional expectations. These conditional expectations are then compared to the actual balances reported on the audited account in order to determine how close the reported balances are to the expectations. If the reported balances are close to the expectations, the accounts are not audited further. If the reported balances are very different from the expectations, there is a higher possibility of a material accounting error and a further audit is conducted.

Regression analysis methods are deployed in a similar way, except the regression model used assumes the availability of only one independent variable. The materiality of the independent variable contributing to the audited account balances are determined using past account balances along with present structural data. Materiality is the importance of an independent variable in its relationship to the dependent variable. In this case, the dependent variable is the account balance. Through this the most important independent variable is used in order to create the conditional expectation and, similar to the ARIMA method, the conditional expectation is then compared to the account balance reported and a decision is made based on the closeness of the two balances.

The STAR methods operate using regression analysis, and fall into two methods. The first is the STAR monthly balance approach, and the conditional expectations made and regression analysis used are both tied to one month being audited. The other method is the STAR annual balance approach, which happens on a larger scale by basing the conditional expectations and regression analysis on one year being audited. Besides the difference in the time being audited, both methods operate the same, by comparing expected and reported balances to determine which accounts to further investigate.

Business Value

As we move into a world of technological advances where more and more data is created and stored digitally, businesses are looking for ways to take advantage of this opportunity and use this information to help generate profits. Predictive analytics can be used and is capable of providing many benefits to a wide range of businesses, including asset management firms, insurance companies, communication companies, and many other firms. In a study conducted by IDC Analyze the Future, Dan Vasset and Henry D. Morris explain how an asset management firm used predictive analytics to develop a better marketing campaign. They went from a mass marketing approach to a customer-centric approach, where instead of sending the same offer to each customer, they would personalize each offer based on their customer. Predictive analytics was used to predict the likelihood that a possible customer would accept a personalized offer. Due to the marketing campaign and predictive analytics, the firm's acceptance rate skyrocketed, with three times the number of people accepting their personalized offers.

Technological advances in predictive analytics have increased its value to firms. One technological advancement is more powerful computers, and with this predictive analytics has become able to create forecasts on large data sets much faster. With the increased computing power also comes more data and applications, meaning a wider array of inputs to use with predictive analytics. Another technological advance includes a more user-friendly interface, allowing a smaller barrier of entry and less extensive training required for employees to utilize the software and applications effectively. Due to these advancements, many more corporations are adopting predictive analytics and seeing the benefits in employee efficiency and effectiveness, as well as profits.

Cash-flow Prediction

ARIMA univariate and multivariate models can be used in forecasting a company's future cash flows, with its equations and calculations based on the past values of certain factors contributing to cash flows. Using time-series analysis, the values of these factors can be analyzed and extrapolated to predict the future cash flows for a company. For the univariate models, past values of cash flows are the only factor used in the prediction. Meanwhile the multivariate models use multiple factors related to accrual data, such as operating income before depreciation.

Another model used in predicting cash-flows was developed in 1998 and is known as the Dechow, Kothari, and Watts model, or DKW (1998). DKW (1998) uses regression analysis in order to determine the relationship between multiple variables and cash flows. Through this method, the model found that cash-flow changes and accruals are negatively related, specifically through current earnings, and using this relationship predicts the cash flows for the next period. The DKW (1998) model derives this relationship through the relationships of accruals and cash flows to accounts payable and receivable, along with inventory.

Child protection

Some child welfare agencies have started using predictive analytics to flag high risk cases. For example, in Hillsborough County, Florida, the child welfare agency's use of a predictive modeling tool has prevented abuse-related child deaths in the target population.

Clinical decision support systems

Predictive analysis have found use in health care primarily to determine which patients are at risk of developing conditions such as diabetes, asthma, or heart disease. Additionally, sophisticated clinical decision support systems incorporate predictive analytics to support medical decision making.

A 2016 study of neurodegenerative disorders provides a powerful example of a CDS platform to diagnose, track, predict and monitor the progression of Parkinson's disease.

Predicting outcomes of legal decisions

The predicting of the outcome of juridical decisions can be done by AI programs. These programs can be used as assistive tools for professions in this industry.

Portfolio, product or economy-level prediction

Often the focus of analysis is not the consumer but the product, portfolio, firm, industry or even the economy. For example, a retailer might be interested in predicting store-level demand for inventory management purposes. Or the Federal Reserve Board might be interested in predicting the unemployment rate for the next year. These types of problems can be addressed by predictive analytics using time series techniques (see below). They can also be addressed via machine learning approaches which transform the original time series into a feature vector space, where the learning algorithm finds patterns that have predictive power.

Underwriting

Many businesses have to account for risk exposure due to their different services and determine the costs needed to cover the risk. Predictive analytics can help underwrite these quantities by predicting the chances of illness, default, bankruptcy, etc. Predictive analytics can streamline the process of customer acquisition by predicting the future risk behavior of a customer using application level data. Predictive analytics in the form of credit scores have reduced the amount of time it takes for loan approvals, especially in the mortgage market. Proper predictive analytics can lead to proper pricing decisions, which can help mitigate future risk of default. Predictive analytics can be used to mitigate moral hazard and prevent accidents from occurring.

See also

References

  1. ^ "To predict or not to Predict". mccoy-partners.com. Retrieved 2022-05-05.
  2. Siegel, Eric (2013). Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die (1st ed.). Wiley. ISBN 978-1-1183-5685-2.
  3. Coker, Frank (2014). Pulse: Understanding the Vital Signs of Your Business (1st ed.). Bellevue, WA: Ambient Light Publishing. pp. 30, 39, 42, more. ISBN 978-0-9893086-0-1.
  4. ^ Eckerson, Wayne, W (2007). "Predictive Analytics. Extending the Value of Your Data Warehousing Investment" (PDF).{{cite web}}: CS1 maint: multiple names: authors list (link)
  5. Finlay, Steven (2014). Predictive Analytics, Data Mining and Big Data. Myths, Misconceptions and Methods (1st ed.). Basingstoke: Palgrave Macmillan. p. 237. ISBN 978-1137379276.
  6. Siegel, Eric (2013). Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die (1st ed.). Wiley. ISBN 978-1-1183-5685-2.
  7. Spalek, Seweryn (2019). Data Analytics in Project Management. Taylor & Francis Group, LLC.
  8. ^ "Definition of Big Data - Gartner Information Technology Glossary". Gartner. Retrieved 2022-04-28.
  9. ^ McCarthy, Richard; McCarthy, Mary; Ceccucci, Wendy (2021). Applying Predictive Analytics: Finding Value in Data. Springer.
  10. "Machine learning, explained". MIT Sloan. Retrieved 2022-05-06.
  11. ^ Kinney, William R. (1978). "ARIMA and Regression in Analytical Review: An Empirical Test". The Accounting Review. 53 (1): 48–60. ISSN 0001-4826. JSTOR 245725.
  12. "Introduction to ARIMA models". people.duke.edu. Retrieved 2022-05-06.
  13. "6.4.3. What is Exponential Smoothing?". www.itl.nist.gov. Retrieved 2022-05-06.
  14. "6.4.1. Definitions, Applications and Techniques". www.itl.nist.gov. Retrieved 2022-05-06.
  15. "6.4.2.1. Single Moving Average". www.itl.nist.gov. Retrieved 2022-05-06.
  16. "6.4.2.2. Centered Moving Average". www.itl.nist.gov. Retrieved 2022-05-06.
  17. "Linear Regression". www.stat.yale.edu. Retrieved 2022-05-06.
  18. ^ Kinney, William R.; Salamon, Gerald L. (1982). "Regression Analysis in Auditing: A Comparison of Alternative Investigation Rules". Journal of Accounting Research. 20 (2): 350–366. doi:10.2307/2490745. ISSN 0021-8456. JSTOR 2490745.
  19. PricewaterhouseCoopers. "Materiality in audits". PwC. Retrieved 2022-05-03.
  20. Vesset, Dan; Morris, Henry D. (June 2011). "The Business Value of Predictive Analytics" (PDF). White Paper: 1–3.
  21. Stone, Paul (April 2007). "Introducing Predictive Analytics: Opportunities". All Days. doi:10.2118/106865-MS.
  22. Lorek, Kenneth S.; Willinger, G. Lee (1996). "A Multivariate Time-Series Prediction Model for Cash-Flow Data". The Accounting Review. 71 (1): 81–102. ISSN 0001-4826. JSTOR 248356.
  23. Barth, Mary E.; Cram, Donald P.; Nelson, Karen K. (2001). "Accruals and the Prediction of Future Cash Flows". The Accounting Review. 76 (1): 27–58. doi:10.2308/accr.2001.76.1.27. ISSN 0001-4826. JSTOR 3068843.
  24. Reform, Fostering (2016-02-03). "New Strategies Long Overdue on Measuring Child Welfare Risk". The Imprint. Retrieved 2022-05-03.
  25. "Within Our Reach: A National Strategy to Eliminate Child Abuse and Neglect Fatalities" (PDF). Commission to Eliminate Child Abuse and Neglect Fatalities. 2016.
  26. Dinov, Ivo D.; Heavner, Ben; Tang, Ming; Glusman, Gustavo; Chard, Kyle; Darcy, Mike; Madduri, Ravi; Pa, Judy; Spino, Cathie; Kesselman, Carl; Foster, Ian (2016-08-05). "Predictive Big Data Analytics: A Study of Parkinson's Disease Using Large, Complex, Heterogeneous, Incongruent, Multi-Source and Incomplete Observations". PLOS ONE. 11 (8): e0157077. Bibcode:2016PLoSO..1157077D. doi:10.1371/journal.pone.0157077. ISSN 1932-6203. PMC 4975403. PMID 27494614.
  27. Aletras, Nikolaos; Tsarapatsanis, Dimitrios; Preoţiuc-Pietro, Daniel; Lampos, Vasileios (2016). "Predicting judicial decisions of the European Court of Human Rights: a Natural Language Processing perspective". PeerJ Computer Science. 2: e93. doi:10.7717/peerj-cs.93. S2CID 7630289.
  28. UCL (2016-10-24). "AI predicts outcomes of human rights trials". UCL News. Retrieved 2022-05-03.
  29. Dhar, Vasant (May 6, 2011). "Prediction in financial markets: The case for small disjuncts". ACM Transactions on Intelligent Systems and Technology. 2 (3): 1–22. doi:10.1145/1961189.1961191. ISSN 2157-6904. S2CID 11213278.
  30. Dhar, Vasant; Chou, Dashin; Provost, Foster (2000-10-01). "Discovering Interesting Patterns for Investment Decision Making with GLOWER ◯-A Genetic Learner Overlaid with Entropy Reduction". Data Mining and Knowledge Discovery. 4 (4): 251–280. doi:10.1023/A:1009848126475. ISSN 1384-5810. S2CID 1982544.
  31. Montserrat, Guillen; Cevolini, Alberto (November 2021). "Using Risk Analytics to Prevent Accidents Before They Occur – The Future of Insurance". Journal of Financial Transformation.

Further reading

Categories: