Tagged: Information RSS Toggle Comment Threads | Keyboard Shortcuts

  • mazsa 11:56 on December 6, 2011 Permalink | Reply
    Tags: , Information, , , ,   

    “And yet, even though useful quantum computers might still be decades away, many of their payoffs are already arriving. For example, the mere possibility of quantum computers has all but overthrown a conception of the universe that scientists like Stephen Wolfram have championed. That conception holds that, as in the “Matrix” movies, the universe itself is basically a giant computer, twiddling an array of 1’s and 0’s in essentially the same way any desktop PC does.

    Quantum computing has challenged that vision by showing that if “the universe is a computer,” then even at a hard-nosed theoretical level, it’s a vastly more powerful kind of computer than any yet constructed by humankind. Indeed, the only ways to evade that conclusion seem even crazier than quantum computing itself: One would have to overturn quantum mechanics, or else find a fast way to simulate quantum mechanics using today’s computers.” http://www.nytimes.com/2011/12/06/science/scott-aaronson-quantum-computing-promises-new-insights.html?_r=1&ref=science&pagewanted=all

    “Carson Chow Says:
    Comment #2 December 5th, 2011 at 10:35 pm
    Nice article but I am confused about this paragraph:

    “For example, the mere possibility of quantum computers has all but overthrown a conception of the universe that scientists like Stephen Wolfram have championed. That conception holds that, as in the “Matrix” movies, the universe itself is basically a giant computer, twiddling an array of 1’s and 0’s in essentially the same way any desktop PC does.”

    A quantum universe or a classical universe are both computable aren’t they? It’s just that the quantum universe is exponentially “bigger”. In principle, you could have a classical computer just chug away painfully slowly and simulate the quantum universe, no? There is nothing in the “Matrix” universe that says the computation must be efficient is there? There are still just a countable number of possible quantum universes right?”

    “Scott Says:
    Comment #5 December 5th, 2011 at 10:59 pm
    Carson #2: Yes, as the tagline of my blog says, quantum computers can be simulated classically but with exponential slowdown.

    What we learn from quantum computing is that, if both quantum mechanics and the prevailing conjectures in complexity theory are valid, then the physical universe can’t be feasibly simulated by a computer that “twiddles an array of 1’s and 0’s in essentially the same way any desktop PC does.”

    (That last clause was meant to indicate that I was talking about efficient simulation by conventional computers — i.e., the Extended Church-Turing Thesis, or what Wikipedia calls the Feasibility Thesis. I wish I knew how to put the point more clearly within the constraints of this article, since you’re right that it might be misinterpreted!)

    For what it’s worth, Stephen Wolfram, Ed Fredkin, and other believers in “digital physics,” have been very explicit in saying that they think the universe is a classical cellular automaton—basically, a three-dimensional array of pixels—and that their view would preclude exponential speedups from quantum computation. (Wolfram believes that quantum mechanics is wrong, whereas Fredkin believes that quantum mechanics can be efficiently simulated classically.) So, these viewpoints would indeed be ruled out under the assumptions I mentioned above.

    A last remark: the Matrix movies aren’t very clear about what type of computer is being used, other than that it’s powered by human bodies! But since they never mention anything about quantum computing, and since the simulation clearly isn’t astronomically slow, it seems reasonable to assume that Keanu Reeves was trapped in some sort of classical simulation. So maybe he could’ve caused the simulation to crash by building a quantum computer and trying to run Shor’s factoring algorithm! For the version where Keanu is trapped in a quantum computation, we might need to wait for the followup trilogy, “The Unitary Matrix” (har, har).”

    “Jiav Says:
    Comment #8 December 6th, 2011 at 12:59 am
    Nice essay Scott, but how could we know our simulation is not astronomically slow?

    I’m curious to see if Greg Egan will comment this one :)

    http://www.scottaaronson.com/blog/?p=871

    Cf. http://theunitedpersons.org/blog/if-the-answer-is-42-what-is-the-question

     
  • mazsa 13:56 on June 7, 2011 Permalink | Reply
    Tags: Information, , , ,   

    INFORMATION AND ITS METRIC “When one speaks of information one refers to that entity shared by all sources that are equivalent up to recoding. This observation suggests a definition of information. Information of the source S is the equivalence class of all recodings of the symbol sequences from S. This is noteworthy since information generally is left undefined in information theory. Information theory only considers the amount of information or rates of production, loss, and transmission, as measured by various entropies. [...]

    Recoding R partitions the space I of unique information sources into mutually disjoint subsets. [...]

    This suggests the definition of the more abstract information space I [...] as the set of equivalence classes of I under recodings R. [...] Elements of shall be denoted X, Y, and so on. [...] The elements of I shall be the objects of interest in the following. The necessary logical distinction between the class X and its constituent sources will be blurred in the following. A reference to X as an information source should be construed as connoting the common properties of its members. As a source, X is the generic source. We can speak, in a similar vein, of the events or measurements of source X. [...]

    Theorem: d is a metric and (I, d) is a metric space. [...]

    The theorem indicates that the space of information sources has quite a bit of topological structure. For example, the notion of [epsilon]-balls of “close” information sources, the continuity of functions on information sources, and the limits and convergence of sequences of information sources, can be developed. These and numerical computations of information distances will follow in a sequel. [...]

    CONCLUDING REMARKS

    One question that arises in this development is why not simply use mutual information instead of the information metric. Aside from the pseudo-geometric picture we have presented, we note that the former measures only a kind of informational correlation. The information metric, however, quantifies the degree of recoding equivalence. And so, it provides some insight into the nature of information itself. Mutual information is a derivative concept that simply reflects the properties Shannon entropy and no more.

    The foregoing mathematical development instantiates a particular philosophical view- point, that of phenomenology. All that an observer has to work with in developing an understanding of the world are finite measurements and the attendant information. This intrinsic finiteness derives first and foremost from the limited computation resources available to an observer in a finite space-time region. The information space, as developed here, is the substrate for all perception, quantification, and modeling building. This is then structured with the pseudo-geometry as we have just shown. Only under suitable restrictions is one justified in using observations to form probabilities via (say) frequencies of events.

    Information theory was founded on a quantitative measure of the amount of information. The foregoing has given a formal definition of information itself in terms of the equivalence class structure of sources. But what of the “meaning” of this information? A motivation of this work, unstated until this point, was the conviction that an understanding of the topological structure of the metric lattice of inferential logic is necessary for developing a quantitative measure of meaning and of context. Thus, we offer no immediate answer to the question, only the hope that progress can be made. We shall return to this question in the future.”

    @inproceedings{crutchfield1990information,
    title={Information and Its Metric},
    author={Crutchfield, JP},
    booktitle={Nonlinear structures in physical systems: pattern formation, chaos, and waves: proceedings of the Second Woodward Conference, San Jose State University, November 17-18, 1989},
    pages={119},
    year={1990},
    organization={Springer}
    }

    Download: http://scholar.google.com/scholar?cluster=2410770660010935934

     
  • mazsa 09:39 on March 10, 2011 Permalink | Reply
    Tags: , , Information, , ,   

    “In the very near future you may be forced to go through a “professional” to get access to your genetic information. [...]” http://www.gnxp.com/wp/2011/03/09/your-genes-your-rights-fdas-jeffrey-shuren-not-a-fan/

     
  • mazsa 08:21 on March 5, 2011 Permalink | Reply
    Tags: , Information, , , ,   

    ISCB Public Policy Statement on Open Access to Scientific and Technical Research Literature http://www.ploscompbiol.org/article/info:doi/10.1371/journal.pcbi.1002014

     
  • mazsa 09:40 on January 18, 2011 Permalink | Reply
    Tags: Information, , , ,   

    Setting standards without kings or votes: “[...] In the intervening 25 years, it turned into a standards organization that creates standards related to the technical operation of the Internet.

    However, the IETF [Internet Engineering Task Force] is quite a bit different from traditional standards organizations such as ANSI, ISO, or the IEEE Standards Association. Standards organizations typically have high thresholds for membership—in some cases, you can only join the club if you’re a country—and only make their standards available for a (high) fee. Not so with the IETF: “There is no membership in the IETF. Anyone may register for and attend any meeting. The closest thing there is to being an IETF member is being on the IETF or Working Group mailing lists.”

    This comes directly from The Tao of IETF, which is the best introduction into this strange and wonderful world—short of attending a meeting in person. If you don’t have that kind of time, two quotes provide a pretty good feel of how the IETF sees itself: “We reject kings, presidents, and voting. We believe in rough consensus and running code” (David Clark). And: “Be conservative in what you send and liberal in what you accept” (Jon Postel). [...]” http://arstechnica.com/tech-policy/news/2011/01/25-years-of-ietf-setting-standards-without-kings-or-votes.ars

     
    • admin 11:02 on March 6, 2011 Permalink | Reply

      “[...] Another aspect of Working Groups that confounds many people is the fact that there is no formal voting. The general rule on disputed topics is that the Working Group has to come to “rough consensus”, meaning that a very large majority of those who care must agree. The exact method of determining rough consensus varies from Working Group to Working Group. Sometimes consensus is determined by “humming” — if you agree with a proposal, you hum when prompted by the chair; if you disagree, you keep your silence. Newcomers find it quite peculiar, but it works. It is up to the chair to decide when the Working Group has reached rough consensus.

      The lack of formal voting has caused some very long delays for some proposals, but most IETF participants who have witnessed rough consensus after acrimonious debates feel that the delays often result in better protocols. (And, if you think about it, how could you have “voting” in a group that anyone can join, and when it’s impossible to count the participants?) Rough consensus has been defined in many ways; a simple version is that it means that strongly held objections must be debated until most people are satisfied that these objections are wrong. [...]” http://www.ietf.org/tao.html

      • admin 11:04 on March 6, 2011 Permalink | Reply

        Daniel A. Nagy
        ‎”We reject: kings, presidents and voting.
        We believe in: rough consensus and running code.”
        13 órája · Nem tetszik ·

        Oleksiy Kononov Makhno rules :D
        13 órája · Tetszik

        Daniel A. Nagy While I’m sure Bat’ka would have endorsed this approach to communication standards, but the quote is actually from David D. Clark, one of the most influential Internet pioneers and is still the guiding principle of IETF, the main standards body of the Internet.
        13 órája · Tetszik

        Daniel A. Nagy http://ietf.org/proceedings/prior29/IETF24.pdf (29 Megabytes!)
        12 órája · Tetszik

        Roberto Rogel Dani, after reading the English Wikipedia article on ‘rough consensus’, I realised there is contradiction in your idea. ‘We’ reject presidents and voting, but rough consensus uses a president figure (called chairperson in the article) and uses voting (called ‘a show of hands’ there). Would you argue Wikipedia’s article regarding rough consensus is totally flawed?
        12 órája · Tetszik

        Daniel A. Nagy It is. I do have some experience in IETF decision making (participation in the OpenPGP WG, specifically the process of drafting RFC4880) and there was no show of hands or presidential decision making. Essentially, we keep arguing until nobody opposes the proposed wording at which point it gets published as a proposed standard. From that point on, it is up to actual implementations to interpret it. If there are at least two independent implementations that interoperate flawlessly on its basis and at least one of them is widely used by the community then it becomes an actual standard.
        12 órája · Nem tetszik · 1 személy

        Roberto Rogel It sounds great as you describe it. Can you edit the Wikipedia’s article?
        12 órája · Tetszik

        Daniel A. Nagy I believe that the correct way to go about it using Wikipedia’s somewhat inferior process of cooperation is to write to the discussion page first. I actually might do that, but now I have more urgent (and frankly, more interesting) things to do. It involves running code. :-)
        12 órája · Tetszik

        Daniel A. Nagy I do believe that IETF and the Internet in general is the ultimate proof of validity of anarchist legal theory. Based on this “rough consensus and running code”, we have built the largest and most complex machine in human history: the Internet incorporates fiber-optic cables on the ocean floor several kilometers under sea level and stationary satellites 35000 km above it. While not perfect, it works remarkably well.
        11 órája · Tetszik

        Peter Földiák http://www.wired.com/wired/archive/3.10/ietf.html
        11 órája · Tetszik · 2 ember

        Roberto Rogel This topic is precisely what I wanted to ask you about long time ago: about your proposed alternative to democracy and other tyrannies of the majorities. Theoretically, it sounds like the optimum decision process, but… I was wondering about its practicallity of implementation and performance (speed of decision making) when used in very large groups (I have in mind big countries with very diverse and polarised ethnic/social/economic sub-groups.
        I have in mind groups where dogma guides their behaviour/decision making. And when/where those dogmas are opposite. The only way to obtain consensus in those scenarios would be for some people to leave their religions/dogmas. And in reality, this is next to impossible. But, as an expert, please let us know whether/how this issue can be solved.
        3 órája · Nem tetszik · 1 személy

        Mázsa Péter ‎[i just want to follow this thread]
        2 órája · Tetszik

        Peter Földiák On the large scale, you only need the market, not consensus (rough or not).
        2 órája · Tetszik

  • mazsa 21:31 on December 6, 2010 Permalink | Reply
    Tags: , Information   

    Discover 3 million eBooks from your choice of booksellers and devices

     
  • mazsa 15:22 on November 5, 2010 Permalink | Reply
    Tags: , Information, , matrix, ,   

    Open problems in the philosophy of information 

    P.15: Wiener’s problem: What is the ontological status of information?

    Most people agree that there is no information without (data) representa- tion. Following Landauer and Bennett 1985 and Landauer 1987, 1991, and 1996, this principle is often interpreted materialistically, as advocat- ing the impossibility of physically disembodied information, through the equation ‘‘representation5physical implementation.’’ The view that there is no information without physical implementation is an inevitable assumption when working on the physics of computation, since computer science must necessarily take into account the physical properties and limits of the carriers of information. It is also the ontological assumption behind the Physical Symbol System Hypothesis in AI and cognitive science (Newell and Simon 1976). However, the fact that information requires a representation does not seem to entail that the latter ought to be physically implemented. Arguably, environments in which there are only noetic entities, properties, and processes (for example, Berkeley and Spinoza), or in which the material or extended universe has a noetic or nonextended matrix as its ontological foundation (for example, Pythag- oras, Plato, Leibniz, and Hegel), seem perfectly capable of upholding the representationalist principle without also embracing a materialist inter- pretation. The relata giving rise to information could be monads, for example. So the problem here becomes: Is the informational an indepen-
    dent ontological category, different from the physical/material and (assuming one could draw this Cartesian distinction) the mental? Wiener, for example, thought that ‘‘information is information, not matter or energy. No materialism which does not admit this can survive at the present day’’ (1948, 132). If the informational is not an independent ontological category, to which category is it reducible? If it is an independent ontological category, how is it related to the physical/ material and the mental? Answers to these questions determine the orientation a theory takes with respect to the following problem:

    P.16: The problem of localization: Can information be naturalized?

    The problem is connected with P.4 – Namely, the semanticization of data. It seems hard to deny that information is a natural phenomenon, so this is not what one should be asking here. Even elementary forms of life, such as sunflowers, survive only because they are capable of informational processes. The problem here is whether there is information in the world independently of forms of life capable of extracting it and if so, what kind of information is in question (an informational version of the teleological argument for the existence of God argues both that information is a natural phenomenon and that the occurrence of environmental informa- tion requires an intelligent source). If the world is sufficiently information rich, perhaps an agent may interact successfully with it by using ‘‘envi- ronmental information’’ directly, without being forced to go through a representation stage in which the world is first analyzed informationally. ‘‘Environmental information’’ still presupposes (or perhaps is identical with) some physical support, but it does not require any higher-level cognitive representation or computational processing to be immediately usable. This is argued, for example, by researchers in AI working on animats (artificial animals, either computer simulated or robotic). Ani- mats are simple reactive agents, stimulus driven. They are capable of elementary, ‘‘intelligent’’ behavior, despite the fact that their design excludes the possibility of internal representations of the environment and any effective computation (see Mandik 2002 for an overview; the case for nonrepresentational intelligence is famously made in Brooks 1991).

    So, are cognitive processes continuous with processes in the environ- ment? Is semantic content (at least partly) external (Putnam)? Does ‘‘natural’’ or ‘‘environmental’’ information pivot on natural signs (Peirce) or on nomic regularities? Consider the typical example provided by the concentric rings visible in the wood of a cut tree trunk, which may be used to estimate the age of the plant. The externalist/extensionalist, who favors a positive answer to P.16 (for example, Dretske or Barwise), is faced by the difficulty of explaining what kind of information and how much of it saturates the world, what kind of access to, or interaction with, ‘‘in- formation in the world’’ an informational agent can enjoy, and how
    information dynamics is possible. The internalist/intentionalist (for example, Fodor or Searle), who privileges a negative answer to P.16, needs to explain in what specific sense information depends on intelli- gence and whether this leads to an antirealist view.
    The location of information is related to the question of whether there can be information without an informee, or whether information, in at least some crucial sense of the word, is essentially parasitic on the meanings in the mind of the informee, and the most it can achieve, in terms of ontological independence, is systematic interpretability. Before the discovery of the Rosetta stone, was it legitimate to regard Egyptian hieroglyphics as information, even if their semantics was beyond the comprehension of any interpreter? I’ve already mentioned that admitting that computers perform some minimal level of protosemantic activity works in favor of a ‘‘realist’’ position about ‘‘information in the world.’’ Before moving to the next problem, it remains to be clarified whether the previous two ways of locating information might not be restrictive. Could information be neither here (intelligence) nor there (natural world) but on the threshold, as it were, as a special relation or interface between the world and its intelligent inhabitants (constructionism)? Or could it even be elsewhere, in a third world, intellectually accessible by intelligent beings but not ontologically dependent on them (Platonism)?

    P.17: The It from Bit hypothesis (Wheeler 1990): Can nature be informationalized?

    The neologism informationalized is ugly but useful to point out that this is the converse of the previous problem. Here too, it is important to clarify what the problem is not. We are not asking whether the metaphorical interpretation of the universe as a computer is more useful than mislead- ing. We are not even asking whether an informational description of the universe, as we know it, is possible, at least partly and piecemeal. This is a challenging task, but formal ontologies already provide a promising answer (Smith 2003). We are asking whether the universe in itself could essentially be made of information, with natural processes, including causation, as special cases of information dynamics (for example, information flow and algorithmic, distributed computation, and forms of emergent computation). Depending on how one approaches the concept of information, it might be necessary to refine the problem in terms of digital data or other informational notions.

    Answers to P.17 deeply affect our understanding of the distinction between virtual and material reality, of the meaning of artificial life in the ALife sense (Bedau 2003), and of the relation between the philosophy of information and the foundations of physics: If the universe is made of information, is quantum physics a theory of physical information? More- over, does this explain some of its paradoxes? If nature can be informa-
    tionalized, does this help to explain how life emerges from matter, and hence how intelligence emerges from life? Of course these questions are closely related to questions listed in section 5: ‘‘Can we build a gradualist bridge from simple amoeba-like automata to highly purposive intentional systems, with identifiable goals, beliefs, etc.?’’ (Dennett 1998, 262).”

    OPEN PROBLEMS IN THE PHILOSOPHY OF INFORMATION
    LUCIANO FLORIDI
    METAPHILOSOPHY Vol. 35, No. 4, July 2004
    pp. 554-582

     
c
compose new post
j
next post/next comment
k
previous post/previous comment
r
reply
e
edit
o
show/hide comments
t
go to top
l
go to login
h
show/hide help
shift + esc
cancel

This site is protected with Urban Giraffe's plugin 'HTML Purified' and Edward Z. Yang's Powered by HTML Purifier. 66561 items have been purified.