dbTalk Databases Forums  

Entropy and Quantity of Information

comp.databases.theory comp.databases.theory


Discuss Entropy and Quantity of Information in the comp.databases.theory forum.



Reply
 
Thread Tools Display Modes
  #11  
Old   
David Cressey
 
Posts: n/a

Default Re: Entropy and Quantity of Information - 01-12-2008 , 03:17 AM







"Joe Thurbon" <usenet (AT) thurbon (DOT) com> wrote

[snip good stuff]

Quote:
I vaguely recall that some of the more theoretical machine learning
results (like learnability and optimality results) rely on a notion
entropy.


I once wrote a little program to play Mastermind (a code guessing game)
using entropy to measure a move's worth. Mastermind can be played using a
brute force tree search. But my program tried out only about 10 moves, and
picked the one with the best entropy. Its play was only slightly inferior
to the play of a brute force tree searcher.





Reply With Quote
  #12  
Old   
David Cressey
 
Posts: n/a

Default Re: Entropy and Quantity of Information - 01-12-2008 , 03:17 AM







"Joe Thurbon" <usenet (AT) thurbon (DOT) com> wrote

[snip good stuff]

Quote:
I vaguely recall that some of the more theoretical machine learning
results (like learnability and optimality results) rely on a notion
entropy.


I once wrote a little program to play Mastermind (a code guessing game)
using entropy to measure a move's worth. Mastermind can be played using a
brute force tree search. But my program tried out only about 10 moves, and
picked the one with the best entropy. Its play was only slightly inferior
to the play of a brute force tree searcher.





Reply With Quote
  #13  
Old   
David Cressey
 
Posts: n/a

Default Re: Entropy and Quantity of Information - 01-12-2008 , 03:17 AM




"Joe Thurbon" <usenet (AT) thurbon (DOT) com> wrote

[snip good stuff]

Quote:
I vaguely recall that some of the more theoretical machine learning
results (like learnability and optimality results) rely on a notion
entropy.


I once wrote a little program to play Mastermind (a code guessing game)
using entropy to measure a move's worth. Mastermind can be played using a
brute force tree search. But my program tried out only about 10 moves, and
picked the one with the best entropy. Its play was only slightly inferior
to the play of a brute force tree searcher.





Reply With Quote
  #14  
Old   
David Cressey
 
Posts: n/a

Default Re: Entropy and Quantity of Information - 01-12-2008 , 03:17 AM




"Joe Thurbon" <usenet (AT) thurbon (DOT) com> wrote

[snip good stuff]

Quote:
I vaguely recall that some of the more theoretical machine learning
results (like learnability and optimality results) rely on a notion
entropy.


I once wrote a little program to play Mastermind (a code guessing game)
using entropy to measure a move's worth. Mastermind can be played using a
brute force tree search. But my program tried out only about 10 moves, and
picked the one with the best entropy. Its play was only slightly inferior
to the play of a brute force tree searcher.





Reply With Quote
  #15  
Old   
David Cressey
 
Posts: n/a

Default Re: Entropy and Quantity of Information - 01-12-2008 , 03:17 AM




"Joe Thurbon" <usenet (AT) thurbon (DOT) com> wrote

[snip good stuff]

Quote:
I vaguely recall that some of the more theoretical machine learning
results (like learnability and optimality results) rely on a notion
entropy.


I once wrote a little program to play Mastermind (a code guessing game)
using entropy to measure a move's worth. Mastermind can be played using a
brute force tree search. But my program tried out only about 10 moves, and
picked the one with the best entropy. Its play was only slightly inferior
to the play of a brute force tree searcher.





Reply With Quote
  #16  
Old   
David Cressey
 
Posts: n/a

Default Re: Entropy and Quantity of Information - 01-12-2008 , 03:17 AM




"Joe Thurbon" <usenet (AT) thurbon (DOT) com> wrote

[snip good stuff]

Quote:
I vaguely recall that some of the more theoretical machine learning
results (like learnability and optimality results) rely on a notion
entropy.


I once wrote a little program to play Mastermind (a code guessing game)
using entropy to measure a move's worth. Mastermind can be played using a
brute force tree search. But my program tried out only about 10 moves, and
picked the one with the best entropy. Its play was only slightly inferior
to the play of a brute force tree searcher.





Reply With Quote
  #17  
Old   
David Cressey
 
Posts: n/a

Default Re: Entropy and Quantity of Information - 01-12-2008 , 03:17 AM




"Joe Thurbon" <usenet (AT) thurbon (DOT) com> wrote

[snip good stuff]

Quote:
I vaguely recall that some of the more theoretical machine learning
results (like learnability and optimality results) rely on a notion
entropy.


I once wrote a little program to play Mastermind (a code guessing game)
using entropy to measure a move's worth. Mastermind can be played using a
brute force tree search. But my program tried out only about 10 moves, and
picked the one with the best entropy. Its play was only slightly inferior
to the play of a brute force tree searcher.





Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.