Gradient boosting akin to XGBoost using a quantum device


I am currently trying to implement a boosting algorithm akin to XGBoost with a quantum device. The reason is that I want to make use of a quantum device to train weak classifiers. However, as far as I know, the current quantum device can only be used for binary variables including both input variables and outputs.

Is it possible to use all binary variables to implement the additive training as it does in the XGBoost?

XGBoost GitHub Project


Posted 2018-05-15T04:25:47.303

Reputation: 71

1Welcome! Might you edit your question, perhaps making it more verbose? Details and explicit references/links can help improve the clarity and readability for people that are less familiar with your particular problem. – agaitaarino – 2018-05-15T05:21:38.407

1Imagine that most people don't know what XGBoost is or how it works. Perhaps some general overview would be beneficial? – DaftWullie – 2018-05-15T05:38:12.747

@DaftWullie I added a link to the Github project if that helps. I guess you'll find a tutorial for XGBoost there. – Sanchayan Dutta – 2018-05-15T06:40:26.090

@QuanFinance: What is the exact problem that you wish to solve on a quantum computer? XGBoost does more than just one thing. – user1271772 – 2018-05-15T19:09:53.120



Boosting Algorithms are considered as iterative functional gradient descent algorithms. These algorithms optimize a cost function over function space by iteratively choosing a function (weak hypothesis) that points in the negative gradient direction. Like other boosting methods, gradient boosting combines weak "learners" into a single strong learner in an iterative fashion.

In the quantum realm, it may be a good idea to invoke the Grover search algorithm to construct the gradient boosting algorithms in an unstructured database with the data structure of a binary tree or another suitable tree structure. Following sample code is an interesting customization of XGBoost in the classical setting. There is a reference implementation of Grover Search in Q# in the following repository. Instead of a single marked state as in this Q# example, we could construct a tree state as an input to implement Grover Search to run through a decision tree to realize quantum gradient tree boosting.

Gokul Alex

Posted 2018-05-15T04:25:47.303

Reputation: 807