I can’t speak for anyone else, so I’m just gonna put my stank on the situation and that’s it.
I “pre-screen” lights, or, well, anything I review. It’s got to be something I’d normally want anyway but maybe didn’t go out of my way to get. First, I don’t want to review crap, waste the time, and have said crap as “payment”. And yeah, there were a few lights I was hesitant to review, but turned out to be quite good. Eg, I thought the WK30 was a “gimmick” light, but turned out to be and still is one of my favorites. The E3A? Liked the freebie so much I bought a few more.
I was offered to review one of those wifi lightbulbs that go r/g/b and variable brightness, and was told that I’d get reimbursed on them seeing my 5-star review. When I asked what if it’s not so great, or if I couldn’t get it working with my phone, etc., then what?, and never got a reply back, so I obviously passed on that.
Most times I’m asked to review something, no one even waits for the review to be posted, and I either get the light comped or just have it shipped to me directly, so it seems implied that I can be honest about it, ’though in reality, yeah, a negative review would probably mean the end of most or maybe even all future reviews. But thankfully, I never got a lemon, and all the lights were top notch in quality, etc.
But if a beam is fried-eggy, I’ll say so. One recent light had the dreaded next-mode memory, and I even bolded “NMM” to highlight it, knowing that for lots of people, that’d be an instant pass. But for The Muggle, it probably wouldn’t be a big deal.
That said, I try to really put a light through its paces, in practical use. I don’t have a light sphere, don’t log light output ’til the cell crokes, none of the hardcore stuff people do in way way way more detailed reviews. So I’ll use it as a nightstand light, around the house, in the yard, around the block, etc., and it’s definitely my impressions as far as usability, etc.
I’ll test any included cells to see if they hit the mark, go over the ano looking for any dings, chips, voids, etc., check the glass and reflector for prints and/or dust, etc., and so on. Unless it’s really bad, I tend to not notice pwm, and normally don’t even think to check if a light has it, but if anyone asks, I’ll definitely check. And I’ll intentionally screw with the UI to see if any odd combinations does anything… weird. I found the “police mode” on the WK30 that way, and I don’t think the original manual/sheet listed it.
So for me, it’s definitely first impressions of the build quality, the UI, the beam, overall ergonomics, etc. For lots of lights/brands, frankly, I have to find something to hate on, even if it’s a nitpick, because it otherwise looks like a glowing shill-review from a fanboy or light-whore. Like, oh yeah, the clip is chromey instead of a matching matte-black.
Or maybe I’m just easily impressed.
That said, too, there are some brands which I won’t touch as far as a review, like Wubens. Aside from the dream TO46R and the quite-nice keychain twisties, all Wubens in my experience have awesome hardware but the most braindead UIs. I’d sing the praises of the hardware, but really hate on the UI to the point of recommending not to buy one, which I doubt would go over very well. But hey, some people like ’em anyway. Also, even solid brands like Sofirn, I loved the original SP10s, A and B, got a bunch, but don’t want an S precisely because of the UI.
So… do what youse want and feel comfortable with. For a free light, a thorough review, even without spheres and runtimes, etc., is a pain in the ass and a lot of work to do. So you gotta be willing to take the time, use the light (none of this unboxing and then clicking a few times crap), take notes, even of subtle quirks, collect your thoughts, write it out, reread, edit, lather, rinse, repeat, ’til you’re happy with the final product. And even then, of course you’ll forget something that you wanted to mention.