Learning naive Bayes regression models with missing data using mixtures of truncated exponentials

In the last years, mixtures of truncated exponentials (MTEs) have received much attention within the context of probabilistic graphical models, as they provide a framework for hybrid Bayesian networks which is compatible with standard inference algorithms and no restriction on the structure of the n...

Full description

Bibliographic Details
Main Authors: Fernández, Antonio, Nielsen, Jens D., Salmerón Cerdán, Antonio
Format: info:eu-repo/semantics/report
Language:English
Published: 2012
Online Access:http://hdl.handle.net/10835/1550
_version_ 1789406724481875968
author Fernández, Antonio
Nielsen, Jens D.
Salmerón Cerdán, Antonio
author_facet Fernández, Antonio
Nielsen, Jens D.
Salmerón Cerdán, Antonio
author_sort Fernández, Antonio
collection DSpace
description In the last years, mixtures of truncated exponentials (MTEs) have received much attention within the context of probabilistic graphical models, as they provide a framework for hybrid Bayesian networks which is compatible with standard inference algorithms and no restriction on the structure of the network is considered. Recently, MTEs have also been successfully applied to regression problems in which the underlying network structure is a na ̈ıve Bayes or a TAN. However, the algorithms described so far in the literature operate over complete databases. In this paper we propose an iterative algorithm for constructing na ̈ıve Bayes regression models from incomplete databases. It is based on a variation of the data augmentation method in which the missing values of the explanatory variables are filled by simulating from their posterior distributions, while the missing values of the response variable are generated from its conditional expectation given the explanatory variables. We illustrate through a set of experiments with various databases that the proposed algorithm behaves reasonably well.
format info:eu-repo/semantics/report
id oai:repositorio.ual.es:10835-1550
institution Universidad de Cuenca
language English
publishDate 2012
record_format dspace
spelling oai:repositorio.ual.es:10835-15502023-04-12T19:40:24Z Learning naive Bayes regression models with missing data using mixtures of truncated exponentials Fernández, Antonio Nielsen, Jens D. Salmerón Cerdán, Antonio In the last years, mixtures of truncated exponentials (MTEs) have received much attention within the context of probabilistic graphical models, as they provide a framework for hybrid Bayesian networks which is compatible with standard inference algorithms and no restriction on the structure of the network is considered. Recently, MTEs have also been successfully applied to regression problems in which the underlying network structure is a na ̈ıve Bayes or a TAN. However, the algorithms described so far in the literature operate over complete databases. In this paper we propose an iterative algorithm for constructing na ̈ıve Bayes regression models from incomplete databases. It is based on a variation of the data augmentation method in which the missing values of the explanatory variables are filled by simulating from their posterior distributions, while the missing values of the response variable are generated from its conditional expectation given the explanatory variables. We illustrate through a set of experiments with various databases that the proposed algorithm behaves reasonably well. 2012-05-28T09:46:48Z 2012-05-28T09:46:48Z 2008 info:eu-repo/semantics/report Proceedings of the Fourth European Workshop on Probabilistic Graphical Models (PGM'08) Pages 105-112. http://hdl.handle.net/10835/1550 en info:eu-repo/semantics/openAccess Fourth European Workshop on Probabilistic Graphical Models (PGM'08)
spellingShingle Fernández, Antonio
Nielsen, Jens D.
Salmerón Cerdán, Antonio
Learning naive Bayes regression models with missing data using mixtures of truncated exponentials
title Learning naive Bayes regression models with missing data using mixtures of truncated exponentials
title_full Learning naive Bayes regression models with missing data using mixtures of truncated exponentials
title_fullStr Learning naive Bayes regression models with missing data using mixtures of truncated exponentials
title_full_unstemmed Learning naive Bayes regression models with missing data using mixtures of truncated exponentials
title_short Learning naive Bayes regression models with missing data using mixtures of truncated exponentials
title_sort learning naive bayes regression models with missing data using mixtures of truncated exponentials
url http://hdl.handle.net/10835/1550
work_keys_str_mv AT fernandezantonio learningnaivebayesregressionmodelswithmissingdatausingmixturesoftruncatedexponentials
AT nielsenjensd learningnaivebayesregressionmodelswithmissingdatausingmixturesoftruncatedexponentials
AT salmeroncerdanantonio learningnaivebayesregressionmodelswithmissingdatausingmixturesoftruncatedexponentials