Views my own. I also have a Substack.
> We can read off one cost from my argument: you'll have to deny Dissent, Unanimity, or Justification.
I haven’t thought about this much at all, but: One idea is that you could avoid the kinds of reflection principle violations involved in preferring mixtures by “rectangularising” the representor (cf. this). I.e., enlarge the representor such that your current expectations match your expectations of your future expectations.
This would violate Unanimity (relative to your original representor), but I’m not sure that’s so bad on its own. I think I’m more worried that it has other bad properties, e.g., maybe we can’t do this without creating “too much” imprecision.
I’m one of the judges of the competition. My comments shouldn't be taken as a full review of a post. And, unfortunately, I won’t have capacity to comment on every post or engage with all replies. Thanks so much to everyone who entered!
(Writing this quickly, sorry.)
I thought the defense of gradedness was very interesting. I worry that any candidate for graded c-betterness is going to have very unappealing properties. For example, the difference-of-midpoints rule is going to violate independence, which I think is rough for a relation that’s supposed to capture c-betterness, because it means the sign of CD(A, B) can flip by just adding background consequences that don’t differ between A and B.
I wonder if we want to instead say that c-betterness is itself vague, which means that there would not be a discrete jump between determinate and indeterminate betterness. You would still have to make an arbitrary choice about where to draw a line for the purposes of decision-making, though.
I’m one of the judges of the competition. My comments shouldn't be taken as a full review of a post. And, unfortunately, I won’t have capacity to comment on every post or engage with all replies. Thanks so much to everyone who entered!
I find the case for bottom-up bracketing very well-argued and compelling.
I’d like to see more engagement with non-identity issues that threaten the action-guidingness of bottom-up bracketing.
I’m one of the judges of the competition. My comments shouldn't be taken as a full review of a post. And, unfortunately, I won’t have capacity to comment on every post or engage with all replies. Thanks so much to everyone who entered!
I think this is a neat and thought-provoking argument that ought to give proponents of cluelessness pause.
My thoughts on this haven’t fully settled, but some reactions:
Good question! Yeah, I can’t think of a real-world process about which I’d want to have maximally imprecise beliefs. (The point of choosing a “demon” in the example is that we would have good reason to worry the process is adversarial if we’re talking about a demon…)
(Is this supposed to be part of an argument against imprecision in general / sufficient imprecision to imply consequentialist cluelessness? Because I don’t think you need anywhere near maximally imprecise beliefs for that. The examples in the paper just use the range [0,1] for simplicity.)
It sounds like you reject this kind of thinking:
cluelessness about some effects (like those in the far future) doesn’t override the obligations given to us by the benefits we’re not clueless about, such as the immediate benefits of our donations to the global poor
I don't think that's unreasonable. Personally, I strongly have the intuition expressed in that quote, though definitely not certain that I will endorse it on reflection.
Wouldn't the better response be to find things we aren't clueless about
The background assumption in this post is that there are no such interventions.
> We start from a place of cluelessness about the effects of our actions on aggregate, cosmos-wide value. Our uncertainty is so deep that we can’t even say whether we expect one action to be better than, worse than, or just as good as another, in terms of its effects on aggregate utility. (See Section 2 of the paper and resources here for arguments as to why we ought to regard ourselves as such.)
Thanks, Ben!
It depends on what the X is. In most real-world cases I don’t think our imprecision ought to be that extreme. (It will also be vague, not “[0,1]” or “(0.01, 0.99)” but, “eh, seems like lots of different precise beliefs are defensible as long as they’re not super close to 1 or 0”, and in that state it will feel reasonable to say that we should strictly prefer such an extreme bet.)
But FWIW I do think there are hypothetical cases where incomparability looks correct. Suppose a demon appears to me and says “The F of every X is between 0 and 1. What’s the probability that the F of the next X is less than ½?” I have no clue what X and F mean. In particular, I have no idea if F is in “natural” units that would compel me to put a uniform prior over F-values. Why not a uniform prior over F^2 or F^-100? So it does seem sensible to have maximally imprecise beliefs here, and to say it’s indeterminate whether we should take bets like yours.
Yes, it feels bad not to strictly prefer a bet which pays 10^10 if F < ½. But adopting a precise prior would commit me to turning down other bets that look extremely good on other arbitrarily-chosen priors, which also feels bad.
Some reasons why animal welfare work seems better:
Right, you might want to say that the distributions added to the representor should not have an epistemic interpretation, but should be thought of as a choice-theoretic representation. That is, we have a choice-theoretic reflection principle (something like, if I know that I’ll in future judge A and B to be permissible, I should judge them to both be permissible now), which along with other constraints forces choice behaviour that is representable by the larger representor.